Akses terbuka
Jurnal
SINTA 1
Sign language emotion and alphabet recognition with hand gestures using convolution neural network
IAES International Journal of Artificial Intelligence · Vol. 14 No. 2 (2025) · hlm. 954–962
ISSN 2252-8938, 2089-4872
Terbit 2025-04-01
Penerbit Institute of Advanced Engineering and Science
Bahasa eng
Abstrak
American sign language (ASL) is a special means of interaction for hard-of-hearing individuals and has precise conventional rules. Since the general public does not know these sign language protocols, there is a need to have an efficient automatic sign-emotion recognition system. The objective of this paper is, to develop a framework that recognizes standard hand gestures. The gesture represents emotions and alphabet. This paper covers the methodology, results and performance factors, for experimentations. This experimentation of ASL-based alphabet and emotion recognition is novel as till now many efforts of alphabets categorization are done but this is the new direction of research where emotions, such as together’, ‘happy’, ‘peace, ’sad’, ‘confused’, and ‘love’ are captured and automatically classified with hand signs. We mention our approach to increase ‘accuracy’, wherein we capture images and regions of interest (ROI). In this article, a specifically designed convolution neural network (CNN), is used to identify emotions from hand gestures and the addition of ROI enhances accuracy. The captured hand gesture dataset of the size of 94,000 images. “peace” sign emotion has the highest recognition rate (‘98.95%’). Alphabet’s “P” and “Q” sign ASL alphabets have the maximum recognition rate of signs. In all, very impressive accuracy of “92%” and above is detected. The limits of the experimentation are as mentioned i) there is no repeatability of accuracy for the same hand gesture; ii) The distance and angle of hand gestures with camera are crucial factors for an experiment; and iii) the alphabet recognition system is not working for the alphabets “J” and “Z”.
Jaringan kolaborasi para penulis
8 penulis ·
16 tautan kepenulisan bersama
· 10 lintas organisasi
Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.
AISSMS Institute of Information Technology Bharati Vidyapeeth (Deemed to be University) Birla Institute of Technology and Science, Pilani - Goa Campus Prince of Songkla University Symbiosis International University Afiliasi tidak diketahui
Organisasi berbeda
Organisasi sama
Afiliasi tidak diketahui
Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.
Sumber metadata: OAI-PMH (metadata jurnal) http://ijai.iaescore.com/index.php/IJAI/oai, pertama di-harvest 8 Nov 2026, terakhir terlihat 16 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
<dc:title xml:lang="en-US">Sign language emotion and alphabet recognition with hand gestures using convolution neural network</dc:title>
<dc:creator>Patil, Varsha K.</dc:creator>
<dc:creator>Pawar, Vijaya R.</dc:creator>
<dc:creator>Patil, Aditya</dc:creator>
<dc:creator>Bairagi, Vinayak</dc:creator>
<dc:subject xml:lang="en-US">Emotion recognition; computer vision; Sign Language; Artificial intelligence; Convolutional neural network (CNN); American Sign Language (ASL); Accuracy; confusion matrix</dc:subject>
<dc:subject xml:lang="en-US">American sign language; Artificial intelligence; Computer vision; Convolutional neural network; Emotion recognition; Region of interest; Sign language;</dc:subject>
<dc:description xml:lang="en-US">American sign language (ASL) is a special means of interaction for hard-of-hearing individuals and has precise conventional rules. Since the general public does not know these sign language protocols, there is a need to have an efficient automatic sign-emotion recognition system. The objective of this paper is, to develop a framework that recognizes standard hand gestures. The gesture represents emotions and alphabet. This paper covers the methodology, results and performance factors, for experimentations. This experimentation of ASL-based alphabet and emotion recognition is novel as till now many efforts of alphabets categorization are done but this is the new direction of research where emotions, such as together’, ‘happy’, ‘peace, ’sad’, ‘confused’, and ‘love’ are captured and automatically classified with hand signs. We mention our approach to increase ‘accuracy’, wherein we capture images and regions of interest (ROI). In this article, a specifically designed convolution neural network (CNN), is used to identify emotions from hand gestures and the addition of ROI enhances accuracy. The captured hand gesture dataset of the size of 94,000 images. “peace” sign emotion has the highest recognition rate (‘98.95%’). Alphabet’s “P” and “Q” sign ASL alphabets have the maximum recognition rate of signs. In all, very impressive accuracy of “92%” and above is detected. The limits of the experimentation are as mentioned i) there is no repeatability of accuracy for the same hand gesture; ii) The distance and angle of hand gestures with camera are crucial factors for an experiment; and iii) the alphabet recognition system is not working for the alphabets “J” and “Z”.</dc:description>
<dc:publisher xml:lang="en-US">Institute of Advanced Engineering and Science</dc:publisher>
<dc:contributor xml:lang="en-US">AISSMS IOIT,Pune</dc:contributor>
<dc:date>2025-04-01</dc:date>
<dc:type>info:eu-repo/semantics/article</dc:type>
<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
<dc:type xml:lang="en-US"></dc:type>
<dc:format>application/pdf</dc:format>
<dc:identifier>https://ijai.iaescore.com/index.php/IJAI/article/view/26169</dc:identifier>
<dc:identifier>10.11591/ijai.v14.i2.pp954-962</dc:identifier>
<dc:source xml:lang="en-US">IAES International Journal of Artificial Intelligence (IJ-AI); Vol 14, No 2: April 2025; 954-962</dc:source>
<dc:source>2252-8938</dc:source>
<dc:source>2089-4872</dc:source>
<dc:source>10.11591/ijai.v14.i2</dc:source>
<dc:language>eng</dc:language>
<dc:relation>https://ijai.iaescore.com/index.php/IJAI/article/view/26169/14423</dc:relation>
<dc:rights xml:lang="en-US">Copyright (c) 2025 Institute of Advanced Engineering and Science</dc:rights>
<dc:rights xml:lang="en-US">http://creativecommons.org/licenses/by-sa/4.0</dc:rights>
</oai_dc:dc>
Sitasi dan pengindeksan
Jumlah menurut tiap indeks pada 13 Nov 2026; setiap indeks menghitung sitasi dengan cara berbeda.
OpenAlex juga mencatat karya ini di: crossref.
Sitasi artikel ini
APA 7
Patil, V. K., Pawar, V. R., Patil, A., & Bairagi, V. (2025). Sign language emotion and alphabet recognition with hand gestures using convolution neural network. IAES International Journal of Artificial Intelligence, 14(2), 954–962. https://doi.org/10.11591/ijai.v14.i2.pp954-962
Salin
IEEE
V. K. Patil, V. R. Pawar, A. Patil, and V. Bairagi, “Sign language emotion and alphabet recognition with hand gestures using convolution neural network,” IAES International Journal of Artificial Intelligence, vol. 14, no. 2, pp. 954–962, 2025, doi: 10.11591/ijai.v14.i2.pp954-962.
Salin
Dibuat dari metadata jurnal; periksa nama penulis sebelum dipakai.