Journal No SINTA rank
Sign Language Detection System Using YOLOv5 Algorithm to Promote Communication Equality People with Disabilities
Scientific Journal of Informatics · Vol. 11 No. 2 (2024) · pp. 549–558
- ISSN
- 2407-7658, 2460-0040
- Published
- 2024-06-13
- Publisher
- Universitas Negeri Semarang
- Language
- eng
Abstract
Purpose: Communication is an important asset in human interaction, but not everyone has equal access to this key asset. Some of us have limitations such as hearing or speech impairments, which require a different communicative approach, namely sign language. These limitations often present accessibility gaps in various sectors, including education and employment, in line with Sustainable Development Goals (SDGs) numbers 4, 8, and 10. This research responds to these challenges by proposing a BISINDO sign language detection system using YOLOv5-NAS-S. The research aims to develop a sign language detection model that is accurate and fast, meets the communicative needs of people with disabilities, and supports the SDGs in reducing the accessibility gap. Methods: The research adopted a transfer learning approach with YOLOv5-NAS-S using BISINDO sign language data against a background of data diversity. Data pre-processing involved Super-Gradients and Roboflow augmentation, while model training was conducted with the Trainer of SuperGradients. Result: The results show that the model achieves a mAP of 97,2% and Recall of 99.6% which indicates a solid ability in separating sign language image classes. This model not only identifies sign language classes but can also predict complex conditions consistently. Novelty: The YOLOv5-NAS-S algorithm shows significant advantages compared to previous studies. The success of this performance is expected to make a positive contribution to efforts to create a more inclusive society, in accordance with the Sustainable Development Goals (SDGs). Further development related to predictive and real-time integration, as well as investigation of possible practical applications in various industries, are some suggestions for further research.
Keywords
Collaboration network of the authors
40 authors · 124 co-authorship links · 13 across different organisations · showing the 40 most connected
Hover or tap a name to highlight its co-authors. Double-click to open the author's page.
- State University of Semarang
- Tun Hussein Onn University of Malaysia
- Telkom University
- Institut Teknologi Sepuluh Nopember
- Universitas Islam Negeri Sjech M. Djamil Djambek Bukittinggi
- Affiliation unknown
- Different organisations
- Same organisation
- Affiliation unknown
- Thicker line = more joint articles · bigger circle = more articles
Show as table
| Co-author | Organisation | Joint articles |
|---|---|---|
| Alamsyah Alamsyah | State University of Semarang | 3 |
| Rofik Rofik | State University of Semarang | 3 |
| Dwika Ananda Agustina Pertiwi | Tun Hussein Onn University of Malaysia | 3 |
| Bambang Eko Susilo | State University of Semarang | 2 |
| Trida Ridho Fariz | State University of Semarang | 2 |
| Sri Sukaesih | State University of Semarang | 2 |
| Aditya Marianti | State University of Semarang | 2 |
| Siti Wahyuni | State University of Semarang | 2 |
| Virgania Sari | State University of Semarang | 2 |
| Florentina Yuni Arini | State University of Semarang | 2 |
| Budi Prasetiyo | State University of Semarang | 2 |
| Kamilah Ahmad | Tun Hussein Onn University of Malaysia | 2 |
| Yosza Dasril | Tun Hussein Onn University of Malaysia | 1 |
| Jumanto Jumanto | State University of Semarang | 1 |
| Endang Sugiharti | State University of Semarang | 1 |
| Riza Arifudin | State University of Semarang | 1 |
| Ahmad Bagas Aditya Ilham | Affiliation unknown | 1 |
| Reiki Aziz Yoga Utama | State University of Semarang | 1 |
| Nuni Widiarti | State University of Semarang | 1 |
| Detri Setiyowati | Affiliation unknown | 1 |
| Nafa Fajriati | State University of Semarang | 1 |
| Rizka Nur Pratama | State University of Semarang | 1 |
| Faith Miftah Maulana | State University of Semarang | 1 |
| Nuni Widiarti | State University of Semarang | 1 |
| Karista Gadis Setiyanda | State University of Semarang | 1 |
| Annisaa Utami | Telkom University | 1 |
| Dimas Fanny Hebrasianto Permadi | Institut Teknologi Sepuluh Nopember | 1 |
| Yesy Diah Rosita | Telkom University | 1 |
| Wiyanda Puspita | State University of Semarang | 1 |
| Ceorido Ghalib Wibowo | State University of Semarang | 1 |
| Ari Nugroho Putro | State University of Semarang | 1 |
| Saiful Amin | Universitas Islam Negeri Sjech M. Djamil Djambek Bukittinggi | 1 |
| Putriaji Hendikawati | State University of Semarang | 1 |
| Dedy Purnawan | Affiliation unknown | 1 |
Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.