Melola Discovery

← Melola Discovery

Journal No SINTA rank

Sign Language Detection System Using YOLOv5 Algorithm to Promote Communication Equality People with Disabilities

Scientific Journal of Informatics · Vol. 11 No. 2 (2024) · pp. 549–558

DOI
10.15294/sji.v11i2.6007
ISSN
2407-7658, 2460-0040
Published
2024-06-13
Publisher
Universitas Negeri Semarang
Language
eng

Abstract

Purpose: Communication is an important asset in human interaction, but not everyone has equal access to this key asset. Some of us have limitations such as hearing or speech impairments, which require a different communicative approach, namely sign language. These limitations often present accessibility gaps in various sectors, including education and employment, in line with Sustainable Development Goals (SDGs) numbers 4, 8, and 10. This research responds to these challenges by proposing a BISINDO sign language detection system using YOLOv5-NAS-S. The research aims to develop a sign language detection model that is accurate and fast, meets the communicative needs of people with disabilities, and supports the SDGs in reducing the accessibility gap. Methods: The research adopted a transfer learning approach with YOLOv5-NAS-S using BISINDO sign language data against a background of data diversity. Data pre-processing involved Super-Gradients and Roboflow augmentation, while model training was conducted with the Trainer of SuperGradients. Result: The results show that the model achieves a mAP of 97,2% and Recall of 99.6% which indicates a solid ability in separating sign language image classes. This model not only identifies sign language classes but can also predict complex conditions consistently. Novelty: The YOLOv5-NAS-S algorithm shows significant advantages compared to previous studies. The success of this performance is expected to make a positive contribution to efforts to create a more inclusive society, in accordance with the Sustainable Development Goals (SDGs). Further development related to predictive and real-time integration, as well as investigation of possible practical applications in various industries, are some suggestions for further research.

Keywords

Collaboration network of the authors

40 authors · 124 co-authorship links · 13 across different organisations · showing the 40 most connected

Hover or tap a name to highlight its co-authors. Double-click to open the author's page.

  • State University of Semarang
  • Tun Hussein Onn University of Malaysia
  • Telkom University
  • Institut Teknologi Sepuluh Nopember
  • Universitas Islam Negeri Sjech M. Djamil Djambek Bukittinggi
  • Affiliation unknown
  • Different organisations
  • Same organisation
  • Affiliation unknown
  • Thicker line = more joint articles · bigger circle = more articles
Show as table
Co-authorOrganisationJoint articles
Alamsyah AlamsyahState University of Semarang3
Rofik RofikState University of Semarang3
Dwika Ananda Agustina PertiwiTun Hussein Onn University of Malaysia3
Bambang Eko SusiloState University of Semarang2
Trida Ridho FarizState University of Semarang2
Sri SukaesihState University of Semarang2
Aditya MariantiState University of Semarang2
Siti WahyuniState University of Semarang2
Virgania SariState University of Semarang2
Florentina Yuni AriniState University of Semarang2
Budi PrasetiyoState University of Semarang2
Kamilah AhmadTun Hussein Onn University of Malaysia2
Yosza DasrilTun Hussein Onn University of Malaysia1
Jumanto JumantoState University of Semarang1
Endang SugihartiState University of Semarang1
Riza ArifudinState University of Semarang1
Ahmad Bagas Aditya IlhamAffiliation unknown1
Reiki Aziz Yoga UtamaState University of Semarang1
Nuni WidiartiState University of Semarang1
Detri SetiyowatiAffiliation unknown1
Nafa FajriatiState University of Semarang1
Rizka Nur PratamaState University of Semarang1
Faith Miftah MaulanaState University of Semarang1
Nuni WidiartiState University of Semarang1
Karista Gadis SetiyandaState University of Semarang1
Annisaa UtamiTelkom University1
Dimas Fanny Hebrasianto PermadiInstitut Teknologi Sepuluh Nopember1
Yesy Diah RositaTelkom University1
Wiyanda PuspitaState University of Semarang1
Ceorido Ghalib WibowoState University of Semarang1
Ari Nugroho PutroState University of Semarang1
Saiful AminUniversitas Islam Negeri Sjech M. Djamil Djambek Bukittinggi1
Putriaji HendikawatiState University of Semarang1
Dedy PurnawanAffiliation unknown1

Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.

Metadata source: OAI-PMH (metadata jurnal) https://journal.unnes.ac.id/journals/sji/oai, first harvested 6 Nov 2026, last seen 8 Nov 2026.
Original metadata (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en">Sign Language Detection System Using YOLOv5 Algorithm to Promote Communication Equality People with Disabilities</dc:title>
	<dc:creator xml:lang="en">Ningsih, Maylinna Rahayu </dc:creator>
	<dc:creator xml:lang="en">Nurriski, Yopi Julia </dc:creator>
	<dc:creator xml:lang="en">Sanjani, Fathimah Az Zahra </dc:creator>
	<dc:creator xml:lang="en">Hakim, M. Faris Al</dc:creator>
	<dc:creator xml:lang="en">Unjung, Jumanto</dc:creator>
	<dc:creator xml:lang="en">Muslim, Much Aziz</dc:creator>
	<dc:subject xml:lang="en">Detection</dc:subject>
	<dc:subject xml:lang="en">Sign language</dc:subject>
	<dc:subject xml:lang="en">Yolov5</dc:subject>
	<dc:subject xml:lang="en">Disability</dc:subject>
	<dc:subject xml:lang="en">SDGs</dc:subject>
	<dc:description xml:lang="en">Purpose: Communication is an important asset in human interaction, but not everyone has equal access to this key asset. Some of us have limitations such as hearing or speech impairments, which require a different communicative approach, namely sign language. These limitations often present accessibility gaps in various sectors, including education and employment, in line with Sustainable Development Goals (SDGs) numbers 4, 8, and 10. This research responds to these challenges by proposing a BISINDO sign language detection system using YOLOv5-NAS-S. The research aims to develop a sign language detection model that is accurate and fast, meets the communicative needs of people with disabilities, and supports the SDGs in reducing the accessibility gap.
Methods: The research adopted a transfer learning approach with YOLOv5-NAS-S using BISINDO sign language data against a background of data diversity. Data pre-processing involved Super-Gradients and Roboflow augmentation, while model training was conducted with the Trainer of SuperGradients.
Result: The results show that the model achieves a mAP of 97,2% and Recall of 99.6% which indicates a solid ability in separating sign language image classes. This model not only identifies sign language classes but can also predict complex conditions consistently.
Novelty: The YOLOv5-NAS-S algorithm shows significant advantages compared to previous studies. The success of this performance is expected to make a positive contribution to efforts to create a more inclusive society, in accordance with the Sustainable Development Goals (SDGs). Further development related to predictive and real-time integration, as well as investigation of possible practical applications in various industries, are some suggestions for further research.</dc:description>
	<dc:publisher xml:lang="en">Universitas Negeri Semarang</dc:publisher>
	<dc:date>2024-06-13</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.unnes.ac.id/journals/sji/article/view/6007</dc:identifier>
	<dc:identifier>10.15294/sji.v11i2.6007</dc:identifier>
	<dc:source xml:lang="en">Scientific Journal of Informatics; Vol. 11 No. 2: Regular Issue; 549-558</dc:source>
	<dc:source>2407-7658</dc:source>
	<dc:source>2460-0040</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.unnes.ac.id/journals/sji/article/view/6007/541</dc:relation>
	<dc:rights xml:lang="en">Copyright (c) 2024 Scientific Journal of Informatics</dc:rights>
</oai_dc:dc>