Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Handling partial occlusions in facial expression recognition with variational autoencoder

Bulletin of Electrical Engineering and Informatics · Vol. 14 No. 5 (2025) · hlm. 3600–3610

DOI
10.11591/eei.v14i5.9690
ISSN
2089-3191, 2302-9285
Terbit
2025-10-01
Penerbit
Institute of Advanced Engineering and Science (IAES)
Bahasa
en
Lisensi
creativecommons.org/licenses/by-sa/4.0/

Abstrak

Facial expression recognition (FER) is essential in various domains such as healthcare, road safety, and marketing, where real-time emotional feedback is crucial. Despite advancements in controlled settings such as well-lit, frontal, and unobstructed conditions, FER still faces significant challenges in natural, unconstrained environments. One of the most difficult issues is the presence of occlusions, which obscure key facial features. To overcome this, multiple strategies have been proposed, generally falling into two categories: those focused on analyzing visible facial regions and those aimed at reconstructing hidden facial features. In this study, we present a variational autoencoder (VAE)-based solution designed to reconstruct facial features obscured by occlusions. Experimental results show our VAE model optimized with the structural similarity index measure (SSIM) cost function achieves superior performance, with recognition rates of 91.2% for eye occlusions and 89.7% for mouth occlusions. The SSIM-optimized VAE effectively reconstructs occlude facial features while preserving structural details, demonstrating significant improvements over conventional approaches. This VAE-based solution proves particularly robust for real-world scenarios involving common facial obstructions like masks or sunglasses, making it valuable for applications in healthcare monitoring, driver safety systems, and human-computer interaction.

Kata kunci

Jaringan kolaborasi para penulis

10 penulis · 17 tautan kepenulisan bersama · 3 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Université Ibn-Tofail
  • Université Sultan Moulay Slimane
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Zakaria Al BakkariUniversité Ibn-Tofail2
Nawfal El MoukhiUniversité Ibn-Tofail1
Soufiane HajbiUniversité Ibn-Tofail1
Moulay Hicham HaninUniversité Ibn-Tofail1
Oussama SbaytiUniversité Ibn-Tofail1
Khalid HousniUniversité Ibn-Tofail1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OpenAlex API (jurnal SINTA, ADR 0048) https://openalex.org/S2765016208, pertama di-harvest 19 Nov 2026, terakhir terlihat 19 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/"><dc:title xml:lang="en">Handling partial occlusions in facial expression recognition with variational autoencoder</dc:title><dc:creator>Abdelaali Kemmou</dc:creator><dc:creator>Adil El Makrani</dc:creator><dc:creator>Ikram El Azami</dc:creator><dc:creator>Moulay Hafid Aabidi</dc:creator><dc:subject>facial expression recognition</dc:subject><dc:subject>partial occlusion</dc:subject><dc:subject>variational autoencoder</dc:subject><dc:subject>structural similarity index</dc:subject><dc:subject>eye occlusion</dc:subject><dc:subject>face masks</dc:subject><dc:subject>sunglasses</dc:subject><dc:subject>unconstrained environments</dc:subject><dc:description xml:lang="en">Facial expression recognition (FER) is essential in various domains such as healthcare, road safety, and marketing, where real-time emotional feedback is crucial. Despite advancements in controlled settings such as well-lit, frontal, and unobstructed conditions, FER still faces significant challenges in natural, unconstrained environments. One of the most difficult issues is the presence of occlusions, which obscure key facial features. To overcome this, multiple strategies have been proposed, generally falling into two categories: those focused on analyzing visible facial regions and those aimed at reconstructing hidden facial features. In this study, we present a variational autoencoder (VAE)-based solution designed to reconstruct facial features obscured by occlusions. Experimental results show our VAE model optimized with the structural similarity index measure (SSIM) cost function achieves superior performance, with recognition rates of 91.2% for eye occlusions and 89.7% for mouth occlusions. The SSIM-optimized VAE effectively reconstructs occlude facial features while preserving structural details, demonstrating significant improvements over conventional approaches. This VAE-based solution proves particularly robust for real-world scenarios involving common facial obstructions like masks or sunglasses, making it valuable for applications in healthcare monitoring, driver safety systems, and human-computer interaction.</dc:description><dc:publisher>Institute of Advanced Engineering and Science (IAES)</dc:publisher><dc:date>2025-10-01</dc:date><dc:type>info:eu-repo/semantics/article</dc:type><dc:format>application/pdf</dc:format><dc:identifier>https://doi.org/10.11591/eei.v14i5.9690</dc:identifier><dc:identifier>10.11591/eei.v14i5.9690</dc:identifier><dc:source>Bulletin of Electrical Engineering and Informatics; Vol 14 No 5 (2025); 3600-3610</dc:source><dc:source>2089-3191</dc:source><dc:source>2302-9285</dc:source><dc:language>en</dc:language><dc:relation>https://beei.org/index.php/EEI/article/download/9690/4402</dc:relation><dc:rights>https://creativecommons.org/licenses/by-sa/4.0/</dc:rights></oai_dc:dc>