Akses terbuka Jurnal SINTA 1
Deep Learning-Based Continuous Sign Language Recognition
Journal of Robotics and Control (JRC) · Vol. 6 No. 3 (2025) · hlm. 1106–1119
- ISSN
- 2715-5072, 2715-5056
- Terbit
- 2025-05-08
- Penerbit
- Universitas Muhammadiyah Yogyakarta
- Bahasa
- eng
Abstrak
This study focuses on the development of a continuous sign language recognition system based on deep neural network models. A new Kazakh Sign Language (QazSL) dataset is created. DL models for continuous KazSL are developed, their accuracy and robustness under different environmental conditions are analyzed, and an optimized model algorithm to improve sign recognition processes are proposed. The main goal is to improve gesture recognition accuracy, account for gesture variability and environmental conditions, and promote the development of adaptive technologies for low-resource languages. This paper proposes a QazSL recognition system using an YOLOv8n and optimized 2DCNN models to improve accessibility for the hearing impaired. The optimized 2DCNN method includes optimal data preprocessing techniques and new training architecture, followed by model training and testing with precision, recall, and accuracy metrics. The proposed systems were trained using an opencourse K-RSL dataset with 5 signers and a newly created QazSL dataset, recorded by 7 signers. The test accuracy of gesture recognition are 98.12% for Yolov8n and 98, 57% for 2DCNN, indicating the robustness and capability of the models for realtime application. Certain issues, such as background variation and gesture consistency, were found to affect recognition under different conditions. This research contributes to the development of AI-based assistive technology to facilitate social inclusion and access to communication for deaf and hard-of-hearing people. By addressing the challenges identified in gesture recognition, this study paves the way for more reliable interactions between users and technology. Future work will focus on optimizing the model further to enhance its performance in varied environments and to expand its applicability across different languages and sign systems.
Kata kunci
Jaringan kolaborasi para penulis
23 penulis · 78 tautan kepenulisan bersama · 49 lintas organisasi
Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.
- L. N. Gumilyov Eurasian National University
- Astana IT University
- Shandong University
- Astana International University
- M.Auezov South Kazakhstan State University
- Kazakh-British Technical University
- South Kazakhstan Medical Academy
- Organisasi lain
- Afiliasi tidak diketahui
- Organisasi berbeda
- Organisasi sama
- Afiliasi tidak diketahui
- Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
| Rekan penulis | Organisasi | Artikel bersama |
|---|---|---|
| Tamara Kokenovna Zhukabayeva | L. N. Gumilyov Eurasian National University | 5 |
| Dilaram Baumuratova | Astana International University | 3 |
| Aigul Adamova | Astana IT University | 2 |
| Nurdaulet Karabayev | L. N. Gumilyov Eurasian National University | 2 |
| Akbota Yerzhanova | S.Seifullin Kazakh Agro Technical University | 1 |
| Dinara Kaibassova | Astana IT University | 1 |
| Zhanat Manbetova | Afiliasi tidak diketahui | 1 |
| Akmaral Kassymova | Afiliasi tidak diketahui | 1 |
| Zhuldyz Tashenova | L. N. Gumilyov Eurasian National University | 1 |
| Saduakas Baizhumanov | Afiliasi tidak diketahui | 1 |
| Kulaisha Aikhynbay | M.Auezov South Kazakhstan State University | 1 |
| Yerik Mardenov | Astana International University | 1 |
| Erik Mardenov | Afiliasi tidak diketahui | 1 |
| Khu Ven–Tsen | M.Auezov South Kazakhstan State University | 1 |
| Oliver Dias | Universitat de Barcelona | 1 |
| Bauyrzhan Berlikozha | Shandong University | 1 |
| Azamat Zhamanov | North American University | 1 |
Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.