Jurnal SINTA 1
Enhanced Emotion Recognition in Videos: A Convolutional Neural Network Strategy for Human Facial Expression Detection and Classification
Indonesian Journal of Electical Engineering and Informatics (IJEEI) · Vol. 11 No. 1 (2023) · hlm. 286–299
- ISSN
- 2089-3272, 2089-3272
- Terbit
- 2023-03-24
- Penerbit
- IAES Indonesian Section
- Bahasa
- en
Abstrak
The human face is essential in conveying emotions, as facial expressions serve as effective, natural, and universal indicators of emotional states. Automated emotion recognition has garnered increasing interest due to its potential applications in various fields, such as human-computer interaction, machine learning, robotic control, and driver emotional state monitoring. With artificial intelligence and computational power advancements, visual emotion recognition has become a prominent research area. Despite extensive research employing machine learning algorithms like convolutional neural networks (CNN), challenges remain concerning input data processing, emotion classification scope, data size, optimal CNN configurations, and performance evaluation. To address these issues, we propose a comprehensive CNN-based model for real-time detection and classification of five primary emotions: anger, happiness, neutrality, sadness, and surprise. We employ the Amsterdam Dynamic Facial Expression Set – Bath Intensity Variations (ADFES-BIV) video dataset, extracting image frames from the video samples. Image processing techniques such as histogram equalization, color conversion, cropping, and resizing are applied to the frames before labeling. The Viola-Jones algorithm is then used for face detection on the processed grayscale images. We develop and train a CNN on the processed image data, implementing dropout, batch normalization, and L2 regularization to reduce overfitting. The ideal hyperparameters are determined through trial and error, and the model's performance is evaluated. The proposed model achieves a recognition accuracy of 99.38%, with the confusion matrix, recall, precision, F1 score, and processing time further quantifying its performance characteristics. The model's generalization performance is assessed using images from the Warsaw Set of Emotional Facial Expression Pictures (WSEFEP) and Extended Cohn-Kanade Database (CK+) datasets. The results demonstrate the efficiency and usability of our proposed approach, contributing valuable insights into real-time visual emotion recognition.
Kata kunci
Jaringan kolaborasi para penulis
40 penulis · 106 tautan kepenulisan bersama · 30 lintas organisasi · menampilkan 40 yang paling banyak terhubung
Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.
- International Islamic University Malaysia
- Yogyakarta State University
- Universitas Gadjah Mada
- University of Kuala Lumpur
- University of Indonesia
- International Centre for Education in Islamic Finance
- University of Sousse
- Organisasi lain
- Organisasi berbeda
- Organisasi sama
- Afiliasi tidak diketahui
- Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
| Rekan penulis | Organisasi | Artikel bersama |
|---|---|---|
| Aris Nasuha | Yogyakarta State University | 5 |
| Anggun Winursito | Yogyakarta State University | 5 |
| Siti Hajar Yusoff | International Islamic University Malaysia | 5 |
| Hasmah Mansor | International Islamic University Malaysia | 4 |
| Malik Arman Morshidi | International Islamic University Malaysia | 4 |
| Ardy Seto Priambodo | Yogyakarta State University | 4 |
| Huda Adibah Mohd Ramli | International Islamic University Malaysia | 3 |
| Rashidah Funke Olanrewaju | International Islamic University Malaysia | 3 |
| Suriza Ahmad Zabidi | International Islamic University Malaysia | 3 |
| Md. Rafiqul Islam | International Islamic University Malaysia | 2 |
| Noreha Abdul Malik | International Islamic University Malaysia | 2 |
| Elsheikh Mohamed Ahmed Elsheikh | International Islamic University Malaysia | 2 |
| Mohammed H. A. Arafa | International Islamic University Malaysia | 2 |
| Kazi Istiaque Ahmed | International Islamic University Malaysia | 2 |
| Diyah Putriani | Universitas Gadjah Mada | 2 |
| Gairuzazmi Mat Ghani | International Islamic University Malaysia | 2 |
| Amart Sulong | International Islamic University Malaysia | 2 |
| Othman Omran Khalifa | International Islamic University Malaysia | 2 |
| Hassan Dao | University of Kuala Lumpur | 2 |
| Abdul Mutholib | International Islamic University Malaysia | 2 |
| Intan Rahmithul Husna Yaldi | International Islamic University Malaysia | 2 |
| Yasmin Mahira Saiful Munir | International Islamic University Malaysia | 2 |
| Tika Arundina | University of Indonesia | 2 |
| Mohd Azmi Omar | International Centre for Education in Islamic Finance | 2 |
| Nur Atikah Muhamat Saleh | International Islamic University Malaysia | 2 |
| Israth Jahan Chowdhury | International Islamic University Malaysia | 1 |
| Nur Aishah Zainal | International Islamic University Malaysia | 1 |
| W. Idris | International Islamic University Malaysia | 1 |
| Siti Noorjannah Ibrahim | International Islamic University Malaysia | 1 |
| Islam Md. Rafiqul | International Islamic University Malaysia | 1 |
| Ali Kadhim Lwas | International Islamic University Malaysia | 1 |
| Md Moktarul Alam | International Islamic University Malaysia | 1 |
| Jalel Chebil | University of Sousse | 1 |
| Jit Singh Mandeep | National University of Malaysia | 1 |
Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.