Jurnal SINTA 1
On the Audio-Visual Emotion Recognition using Convolutional Neural Networks and Extreme Learning Machine
Indonesian Journal of Electical Engineering and Informatics (IJEEI) · Vol. 10 No. 3 (2022) · hlm. 684–697
- ISSN
- 2089-3272, 2089-3272
- Terbit
- 2022-09-25
- Penerbit
- IAES Indonesian Section
- Bahasa
- en
Abstrak
The advances in artificial intelligence and machine learning concerning emotion recognition have been enormous and in previously inconceivable ways. Inspired by the promising evolution in human-computer interaction, this paper is based on developing a multimodal emotion recognition system. This research encompasses two modalities as input, namely speech and video. In the proposed model, the input video samples are subjected to image pre-processing and image frames are obtained. The signal is pre-processed and transformed into the frequency domain for the audio input. The aim is to obtain Mel-spectrogram, which is processed further as images. Convolutional neural networks are used for training and feature extraction for both audio and video with different configurations. The fusion of outputs from two CNNs is done using two extreme learning machines. For classification, the proposed system incorporates a support vector machine. The model is evaluated using three databases, namely eNTERFACE, RML, and SAVEE. For the eNTERFACE dataset, the accuracy obtained without and with augmentation was 87.2% and 94.91%, respectively. The RML dataset yielded an accuracy of 98.5%, and for the SAVEE dataset, the accuracy reached 97.77%. Results achieved from this research are an illustration of the fruitful exploration and effectiveness of the proposed system.
Kata kunci
Jaringan kolaborasi para penulis
40 penulis · 106 tautan kepenulisan bersama · 30 lintas organisasi · menampilkan 40 yang paling banyak terhubung
Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.
- International Islamic University Malaysia
- Yogyakarta State University
- Universitas Gadjah Mada
- University of Kuala Lumpur
- University of Indonesia
- International Centre for Education in Islamic Finance
- University of Sousse
- Organisasi lain
- Organisasi berbeda
- Organisasi sama
- Afiliasi tidak diketahui
- Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
| Rekan penulis | Organisasi | Artikel bersama |
|---|---|---|
| Aris Nasuha | Yogyakarta State University | 5 |
| Anggun Winursito | Yogyakarta State University | 5 |
| Siti Hajar Yusoff | International Islamic University Malaysia | 5 |
| Hasmah Mansor | International Islamic University Malaysia | 4 |
| Malik Arman Morshidi | International Islamic University Malaysia | 4 |
| Ardy Seto Priambodo | Yogyakarta State University | 4 |
| Huda Adibah Mohd Ramli | International Islamic University Malaysia | 3 |
| Rashidah Funke Olanrewaju | International Islamic University Malaysia | 3 |
| Suriza Ahmad Zabidi | International Islamic University Malaysia | 3 |
| Md. Rafiqul Islam | International Islamic University Malaysia | 2 |
| Noreha Abdul Malik | International Islamic University Malaysia | 2 |
| Elsheikh Mohamed Ahmed Elsheikh | International Islamic University Malaysia | 2 |
| Mohammed H. A. Arafa | International Islamic University Malaysia | 2 |
| Kazi Istiaque Ahmed | International Islamic University Malaysia | 2 |
| Diyah Putriani | Universitas Gadjah Mada | 2 |
| Gairuzazmi Mat Ghani | International Islamic University Malaysia | 2 |
| Amart Sulong | International Islamic University Malaysia | 2 |
| Othman Omran Khalifa | International Islamic University Malaysia | 2 |
| Hassan Dao | University of Kuala Lumpur | 2 |
| Abdul Mutholib | International Islamic University Malaysia | 2 |
| Intan Rahmithul Husna Yaldi | International Islamic University Malaysia | 2 |
| Yasmin Mahira Saiful Munir | International Islamic University Malaysia | 2 |
| Tika Arundina | University of Indonesia | 2 |
| Mohd Azmi Omar | International Centre for Education in Islamic Finance | 2 |
| Nur Atikah Muhamat Saleh | International Islamic University Malaysia | 2 |
| Israth Jahan Chowdhury | International Islamic University Malaysia | 1 |
| Nur Aishah Zainal | International Islamic University Malaysia | 1 |
| W. Idris | International Islamic University Malaysia | 1 |
| Siti Noorjannah Ibrahim | International Islamic University Malaysia | 1 |
| Islam Md. Rafiqul | International Islamic University Malaysia | 1 |
| Ali Kadhim Lwas | International Islamic University Malaysia | 1 |
| Md Moktarul Alam | International Islamic University Malaysia | 1 |
| Jalel Chebil | University of Sousse | 1 |
| Jit Singh Mandeep | National University of Malaysia | 1 |
Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.