Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Convolutional Neural Networks for Measuring Service Satisfaction of Hajj Pilgrims through Facial Expression Analysis

Jurnal Online Informatika · Vol. 11 No. 1 (2026) · hlm. 142–155

DOI
10.15575/join.v11i1.1677
ISSN
2527-9165, 2528-1682
Terbit
2026-04-30
Penerbit
Sunan Gunung Djati State Islamic University Bandung
Bahasa
en
Lisensi
creativecommons.org/licenses/by-nd/4.0/

Abstrak

Facial expressions serve as important non-verbal indicators of human emotions and can be leveraged to assess satisfaction levels in service environments. In the context of Hajj and Umrah, where verbal feedback may be limited due to language barriers or cultural factors, facial expression recognition offers a non-intrusive method to evaluate service quality. This study proposes a Convolutional Neural Network (CNN)-based model to detect emotional states such as happiness and dissatisfaction through facial expressions of pilgrims. A quantitative approach was adopted, employing preprocessing techniques including normalization, augmentation, and image resizing. The CNN architecture comprised multiple convolutional, pooling, and fully connected layers. The model was evaluated using accuracy, precision, recall, and F1-score metrics. Experiments with varying batch sizes (32, 64, 128, 256) across 50 epochs revealed that the optimal performance was achieved with a batch size of 64, resulting in an accuracy of 63%, precision of 66%, recall of 60%, and F1-score of 62%. During deployment, the model correctly classified 12 out of 16 real-world images, achieving a real-time accuracy of 78%. Therefore, the deployment results should be considered preliminary. Future studies will involve larger deployment samples, n-fold stratified cross-validation to obtain statistically reliable model performance, and subgroup analyses (e.g., lighting, facial pose, age, and gender) to better understand model behavior under diverse real-world conditions. All deployment images were collected with participant consent and processed without storing biometric data. These findings suggest that CNN-based emotion recognition can support real-time service evaluation and enhance the quality of pilgrim services during the Hajj and Umrah.

Kata kunci

Jaringan kolaborasi para penulis

40 penulis · 123 tautan kepenulisan bersama · 52 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Sunan Gunung Djati State Islamic University Bandung
  • Politeknik Negeri Bandung
  • Pukyong National University
  • Universitas Gadjah Mada
  • Universitas Masoem
  • Fujian Normal University
  • Universitas Negeri Padang
  • Organisasi lain
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Yana Aditia GerhanaSunan Gunung Djati State Islamic University Bandung4
Deden SuparmanSunan Gunung Djati State Islamic University Bandung3
Ayu Puji RahayuFujian Normal University3
Maisevli HarikaPukyong National University2
Sandi RahmadikaUniversitas Negeri Padang2
Rizka AlawiyahSunan Gunung Djati State Islamic University Bandung2
Gina Giftia Azmiana DelilahSunan Gunung Djati State Islamic University Bandung2
Ichsan BudimanUniversity of Birmingham2
Jaja JahariSunan Gunung Djati State Islamic University Bandung1
Junun SartohadiUniversitas Gadjah Mada1
M WidyastutiUniversitas Gadjah Mada1
Erwin SetiawanSunan Gunung Djati State Islamic University Bandung1
Muhammad Rizqi SholahuddinPoliteknik Negeri Bandung1
Iwan AwaludinPoliteknik Negeri Bandung1
Yunita Citra DewiPoliteknik Negeri Bandung1
Fachri Dhia FauzanPoliteknik Negeri Bandung1
Bima Putra SudimulyaPoliteknik Negeri Bandung1
Vandha Pradiyasma WidartaPukyong National University1
Wisnu UriawanSunan Gunung Djati State Islamic University Bandung1
Ganteng Eki PribadiSunan Gunung Djati State Islamic University Bandung1
Mohamad IrfanSunan Gunung Djati State Islamic University Bandung1
Cecep Nurul AlamSunan Gunung Djati State Islamic University Bandung1
Muhammad HamdaniSunan Gunung Djati State Islamic University Bandung1
Aldy Rialdy AtmadjaSunan Gunung Djati State Islamic University Bandung1
Wildan Budiawan ZulfikarSunan Gunung Djati State Islamic University Bandung1
Aaz Muhammad Hafidz AzisSunan Gunung Djati State Islamic University Bandung1
Vandha Pradwiyasma WidarthaPukyong National University1
Setiadi RachmatPoliteknik Negeri Bandung1
Nurul Dewi AuliaSunan Gunung Djati State Islamic University Bandung1
Zulfa Audina DwiSunan Gunung Djati State Islamic University Bandung1
Supriyanto SupriyantoPoliteknik Negeri Bandung1
Maya Sri RamadianiPoliteknik Negeri Bandung1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OpenAlex API (jurnal SINTA, ADR 0048) https://openalex.org/S4210216628, pertama di-harvest 21 Nov 2026, terakhir terlihat 21 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/"><dc:title xml:lang="en">Convolutional Neural Networks for Measuring Service Satisfaction of Hajj Pilgrims through Facial Expression Analysis</dc:title><dc:creator>Undang Syaripudin</dc:creator><dc:creator>Jumadi Jumadi Jumadi</dc:creator><dc:creator>Diena Rauda Ramdania</dc:creator><dc:creator>Indah Sri Lestari</dc:creator><dc:creator>Indri Nurfiani</dc:creator><dc:creator>Alfin Yogi Setyawan</dc:creator><dc:creator>Maisevli Harika</dc:creator><dc:creator>Mimin Mintarsih</dc:creator><dc:subject>facial expression recognition</dc:subject><dc:subject>emotion recognition</dc:subject><dc:subject>service satisfaction</dc:subject><dc:subject>Hajj pilgrims</dc:subject><dc:subject>Umrah</dc:subject><dc:subject>convolutional neural networks</dc:subject><dc:subject>service quality evaluation</dc:subject><dc:subject>real-time emotion recognition</dc:subject><dc:subject>batch size optimization</dc:subject><dc:description xml:lang="en">Facial expressions serve as important non-verbal indicators of human emotions and can be leveraged to assess satisfaction levels in service environments. In the context of Hajj and Umrah, where verbal feedback may be limited due to language barriers or cultural factors, facial expression recognition offers a non-intrusive method to evaluate service quality. This study proposes a Convolutional Neural Network (CNN)-based model to detect emotional states such as happiness and dissatisfaction through facial expressions of pilgrims. A quantitative approach was adopted, employing preprocessing techniques including normalization, augmentation, and image resizing. The CNN architecture comprised multiple convolutional, pooling, and fully connected layers. The model was evaluated using accuracy, precision, recall, and F1-score metrics. Experiments with varying batch sizes (32, 64, 128, 256) across 50 epochs revealed that the optimal performance was achieved with a batch size of 64, resulting in an accuracy of 63%, precision of 66%, recall of 60%, and F1-score of 62%. During deployment, the model correctly classified 12 out of 16 real-world images, achieving a real-time accuracy of 78%. Therefore, the deployment results should be considered preliminary. Future studies will involve larger deployment samples, n-fold stratified cross-validation to obtain statistically reliable model performance, and subgroup analyses (e.g., lighting, facial pose, age, and gender) to better understand model behavior under diverse real-world conditions. All deployment images were collected with participant consent and processed without storing biometric data. These findings suggest that CNN-based emotion recognition can support real-time service evaluation and enhance the quality of pilgrim services during the Hajj and Umrah.</dc:description><dc:publisher>Sunan Gunung Djati State Islamic University Bandung</dc:publisher><dc:date>2026-04-30</dc:date><dc:type>info:eu-repo/semantics/article</dc:type><dc:format>application/pdf</dc:format><dc:identifier>https://doi.org/10.15575/join.v11i1.1677</dc:identifier><dc:identifier>10.15575/join.v11i1.1677</dc:identifier><dc:source>Jurnal Online Informatika; Vol 11 No 1 (2026); 142-155</dc:source><dc:source>2527-9165</dc:source><dc:source>2528-1682</dc:source><dc:language>en</dc:language><dc:relation>https://join.if.uinsgd.ac.id/index.php/join/article/download/1677/391</dc:relation><dc:rights>https://creativecommons.org/licenses/by-nd/4.0/</dc:rights></oai_dc:dc>