Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Emotions and gesture recognition using affective computing assessment with deep learning

IAES International Journal of Artificial Intelligence · Vol. 12 No. 3 (2023) · hlm. 1419–1427

DOI
10.11591/ijai.v12.i3.pp1419-1427
ISSN
2252-8938, 2089-4872
Terbit
2023-09-01
Penerbit
Institute of Advanced Engineering and Science
Bahasa
eng
Lisensi
creativecommons.org/licenses/by-sa/4.0

Abstrak

Emotions have an important role in education. Affective development, attitudes, and emotions in learning are measured using affective assessment. This method is the right way to determine the student’s affective development. However, the process did not run optimally because the teacher found it difficult to collect student’s affective data. This paper describes the development of a system that can assist teachers in carrying out affective assessment. The system was developed using a v-model that aligns the verification phase with the validation. The use of the system is carried out during learning activities. The emotion detection system detects through body gestures using PoseNet to generate emotional data for each student. The detection results are then processed and displayed on an information system in the form of a website for affective assessment. The accuracy of emotion detection got validation values of 84.4% and 80.95% after being tested at school. In addition, the acceptance test with the usability aspect of the system by the teacher got a score of 77.56% and a score of 79.85% by the students. Based on several tests carried out, this developed system can assist the process of implementing affective assessment.

Kata kunci

Jaringan kolaborasi para penulis

26 penulis · 75 tautan kepenulisan bersama · 25 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • International Islamic University Malaysia
  • Yogyakarta State University
  • National Institutes of Health
  • Sebelas Maret University
  • Universitas Jambi
  • Afiliasi tidak diketahui
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Teddy Surya GunawanInternational Islamic University Malaysia7
Aris NasuhaYogyakarta State University3
Anggun WinursitoYogyakarta State University3
Mira KartiwiInternational Islamic University Malaysia3
Mohamed Hadi HabaebiInternational Islamic University Malaysia2
Ali SophianInternational Islamic University Malaysia2
Arselan AshrafInternational Islamic University Malaysia2
Ardy Seto PriambodoYogyakarta State University2
Rashidah Funke OlanrewajuInternational Islamic University Malaysia1
Mir Suhail AlamInternational Islamic University Malaysia1
Malik Arman MorshidiInternational Islamic University Malaysia1
Suprapto SupraptoYogyakarta State University1
Muslikhin MuslikhinYogyakarta State University1
Zainihariyati Mohd ZainAfiliasi tidak diketahui1
Anis Nurashikin NordinInternational Islamic University Malaysia1
Rosminazuin Ab RahimInternational Islamic University Malaysia1
Faisal Ahmed AssaigInternational Islamic University Malaysia1
Rozainanee Mohd ZainNational Institutes of Health1
Mohamed Alfian Al-Zikry HazlanInternational Islamic University Malaysia1
Mashkuri YaacobInternational Islamic University Malaysia1
Herman Dwi SurjonoYogyakarta State University1
Fendi Aji PurnomoSebelas Maret University1
Rustam AsnawiYogyakarta State University1
Usman UsmanUniversitas Jambi1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) http://ijai.iaescore.com/index.php/IJAI/oai, pertama di-harvest 8 Nov 2026, terakhir terlihat 16 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Emotions and gesture recognition using affective computing assessment with deep learning</dc:title>
	<dc:creator>Artanto, Herjuna</dc:creator>
	<dc:creator>Arifin, Fatchul</dc:creator>
	<dc:subject xml:lang="en-US">Deep Learning; Information System</dc:subject>
	<dc:subject xml:lang="en-US">Affective assessment; Body gestures; Deep learning; Emotions; Posenet</dc:subject>
	<dc:description xml:lang="en-US">Emotions have an important role in education. Affective development, attitudes, and emotions in learning are measured using affective assessment. This method is the right way to determine the student’s affective development. However, the process did not run optimally because the teacher found it difficult to collect student’s affective data. This paper describes the development of a system that can assist teachers in carrying out affective assessment. The system was developed using a v-model that aligns the verification phase with the validation. The use of the system is carried out during learning activities. The emotion detection system detects through body gestures using PoseNet to generate emotional data for each student. The detection results are then processed and displayed on an information system in the form of a website for affective assessment. The accuracy of emotion detection got validation values of 84.4% and 80.95% after being tested at school. In addition, the acceptance test with the usability aspect of the system by the teacher got a score of 77.56% and a score of 79.85% by the students. Based on several tests carried out, this developed system can assist the process of implementing affective assessment. </dc:description>
	<dc:publisher xml:lang="en-US">Institute of Advanced Engineering and Science</dc:publisher>
	<dc:contributor xml:lang="en-US">Biomedical, Electronics and Artificial Intelligence System Laboratory of Engineering Faculty Universitas Negeri Yogyakarta</dc:contributor>
	<dc:date>2023-09-01</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US"></dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://ijai.iaescore.com/index.php/IJAI/article/view/22156</dc:identifier>
	<dc:identifier>10.11591/ijai.v12.i3.pp1419-1427</dc:identifier>
	<dc:source xml:lang="en-US">IAES International Journal of Artificial Intelligence (IJ-AI); Vol 12, No 3: September 2023; 1419-1427</dc:source>
	<dc:source>2252-8938</dc:source>
	<dc:source>2089-4872</dc:source>
	<dc:source>10.11591/ijai.v12.i3</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://ijai.iaescore.com/index.php/IJAI/article/view/22156/13716</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2023 Institute of Advanced Engineering and Science</dc:rights>
	<dc:rights xml:lang="en-US">http://creativecommons.org/licenses/by-sa/4.0</dc:rights>
</oai_dc:dc>