Jurnal SINTA 2
Facial Expression Recognition using Residual Convnet with Image Augmentations
Jurnal Ilmu Komputer dan Informasi (JIKI) · Vol. 14 No. 2 (2021) · pp. 127–135
- ISSN
- 2502-9274, 2088-7051
- Published
- 2021-07-04
- Publisher
- Faculty of Computer Science - Universitas Indonesia
- Language
- eng
Abstract
During the COVID-19 pandemic, many offline activities are turned into online activities via video meetings to prevent the spread of the COVID 19 virus. In the online video meeting, some micro-interactions are missing when compared to direct social interactions. The use of machines to assist facial expression recognition in online video meetings is expected to increase understanding of the interactions among users. Many studies have shown that CNN-based neural networks are quite effective and accurate in image classification. In this study, some open facial expression datasets were used to train CNN-based neural networks with a total number of training data of 342,497 images. This study gets the best results using ResNet-50 architecture with Mish activation function and Accuracy Booster Plus block. This architecture is trained using the Ranger and Gradient Centralization optimization method for 60000 steps with a batch size of 256. The best results from the training result in accuracy of AffectNet validation data of 0.5972, FERPlus validation data of 0.8636, FERPlus test data of 0.8488, and RAF-DB test data of 0.8879. From this study, the proposed method outperformed plain ResNet in all test scenarios without transfer learning, and there is a potential for better performance with the pre-training model. The code is available at https://github.com/yusufrahadika-facial-expressions-essay.
Keywords
Collaboration network of the authors
40 authors · 85 co-authorship links · 5 across different organisations · showing the 40 most connected
Hover or tap a name to highlight its co-authors. Double-click to open the author's page.
- University of Brawijaya
- Institut Teknologi Sepuluh Nopember
- Affiliation unknown
- Different organisations
- Same organisation
- Affiliation unknown
- Thicker line = more joint articles · bigger circle = more articles
Show as table
| Co-author | Organisation | Joint articles |
|---|---|---|
| Indriati Indriati | University of Brawijaya | 2 |
| Fitra Abdurrachman Bachtiar | University of Brawijaya | 2 |
| Achmad Ridok | University of Brawijaya | 2 |
| Agus Zainal Arifin | Institut Teknologi Sepuluh Nopember | 1 |
| Evy Kamilah Ratnasari | Institut Teknologi Sepuluh Nopember | 1 |
| Siti Mutrofin | Institut Teknologi Sepuluh Nopember | 1 |
| Chastine Fatichah | Institut Teknologi Sepuluh Nopember | 1 |
| Ratih Kartika Dewi | University of Brawijaya | 1 |
| Putra Pandu Adikara | University of Brawijaya | 1 |
| Sigit Adinugroho | University of Brawijaya | 1 |
| Agus Wahyu Widodo | University of Brawijaya | 1 |
| Bayu Rahayudi | University of Brawijaya | 1 |
| Rizky Maulana Iqbal | University of Brawijaya | 1 |
| Edy Santoso | University of Brawijaya | 1 |
| Raditya Rinandyaswara | University of Brawijaya | 1 |
| Muhammad Tanzil Furqon | University of Brawijaya | 1 |
| Rifki Akbar Siregar | University of Brawijaya | 1 |
| M. Sofyan Irwanto | University of Brawijaya | 1 |
| Candra Dewi | University of Brawijaya | 1 |
| Nurfatima Selle | University of Brawijaya | 1 |
| Zainal Arifien | University of Brawijaya | 1 |
| Fitra Abdurrahman Bachtiar | Affiliation unknown | 1 |
| Alfisyar Jefry Pranata | University of Brawijaya | 1 |
| Edy Santoso | University of Brawijaya | 1 |
| Natasya Eldha Oktaviana | University of Brawijaya | 1 |
| Alvin Tarisa Akbar | University of Brawijaya | 1 |
| Michael Stephen Lui | University of Brawijaya | 1 |
| Daniel Geoffrey Manurung | University of Brawijaya | 1 |
| Mohammad Ryan Pinasthika | University of Brawijaya | 1 |
| Muhammad Azka Obila Vasya | University of Brawijaya | 1 |
| Rania Aprilia Dwi Setya Putri | University of Brawijaya | 1 |
| Agustinus Parasian Tampubolon | University of Brawijaya | 1 |
| Rakan Fadhil Prayata | University of Brawijaya | 1 |
| Septia Khoirin Nisa | University of Brawijaya | 1 |
| Assyfa Rasida Hanum | University of Brawijaya | 1 |
| Ivykaeyla Adriana Zetha | University of Brawijaya | 1 |
| Lailil Muflikhah | University of Brawijaya | 1 |
Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.