Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Translation of Mexican sign language into Spanish using machine learning and internet of things devices

Bulletin of Electrical Engineering and Informatics · Vol. 13 No. 5 (2024) · hlm. 3369–3379

DOI
10.11591/eei.v13i5.7853
ISSN
2089-3191, 2302-9285
Terbit
2024-07-19
Penerbit
Institute of Advanced Engineering and Science (IAES)
Bahasa
en
Lisensi
creativecommons.org/licenses/by-sa/4.0/

Abstrak

This paper describes an application based on internet of things (IoT) and gesture recognition through the MediaPipe library to communicate people with hearing and speech disabilities who use Mexican sign language (MSL) with people who do not have a disability. The system is made up of two modules, on the one hand, there is an Apple watch with the ability to obtain text and voice inputs in Spanish to stand for the translation into sign language through video and images. The system can set up a connection with an application in charge of performing sign recognition by capturing images from a camera, the IoT user can connect so that communication between both modules is carried out bidirectionally through Firebase database. During the development of the experimental tests, the visual recognition module was able to recognize signs belonging to the Spanish alphabet, digits, and greetings, with a 96% of precision, while the IoT device correctly displayed voice translations and text to symbology compared to the MSL.

Kata kunci

Jaringan kolaborasi para penulis

4 penulis · 5 tautan kepenulisan bersama

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Universidad Autónoma del Estado de México
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Hector CaballeroUniversidad Autónoma del Estado de México2

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OpenAlex API (jurnal SINTA, ADR 0048) https://openalex.org/S2765016208, pertama di-harvest 19 Nov 2026, terakhir terlihat 19 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/"><dc:title xml:lang="en">Translation of Mexican sign language into Spanish using machine learning and internet of things devices</dc:title><dc:creator>Héctor Caballero Hernández</dc:creator><dc:creator>Vianney Muñoz Jiménez</dc:creator><dc:creator>Marco Antonio Ramos</dc:creator><dc:subject>Mexican Sign Language</dc:subject><dc:subject>sign language translation</dc:subject><dc:subject>speech-to-sign translation</dc:subject><dc:subject>gesture recognition</dc:subject><dc:subject>MediaPipe</dc:subject><dc:subject>Internet of Things</dc:subject><dc:subject>Apple Watch</dc:subject><dc:subject>hearing loss</dc:subject><dc:subject>speech disorders</dc:subject><dc:subject>assistive communication technology</dc:subject><dc:subject>Firebase</dc:subject><dc:description xml:lang="en">This paper describes an application based on internet of things (IoT) and gesture recognition through the MediaPipe library to communicate people with hearing and speech disabilities who use Mexican sign language (MSL) with people who do not have a disability. The system is made up of two modules, on the one hand, there is an Apple watch with the ability to obtain text and voice inputs in Spanish to stand for the translation into sign language through video and images. The system can set up a connection with an application in charge of performing sign recognition by capturing images from a camera, the IoT user can connect so that communication between both modules is carried out bidirectionally through Firebase database. During the development of the experimental tests, the visual recognition module was able to recognize signs belonging to the Spanish alphabet, digits, and greetings, with a 96% of precision, while the IoT device correctly displayed voice translations and text to symbology compared to the MSL.</dc:description><dc:publisher>Institute of Advanced Engineering and Science (IAES)</dc:publisher><dc:date>2024-07-19</dc:date><dc:type>info:eu-repo/semantics/article</dc:type><dc:format>application/pdf</dc:format><dc:identifier>https://doi.org/10.11591/eei.v13i5.7853</dc:identifier><dc:identifier>10.11591/eei.v13i5.7853</dc:identifier><dc:source>Bulletin of Electrical Engineering and Informatics; Vol 13 No 5 (2024); 3369-3379</dc:source><dc:source>2089-3191</dc:source><dc:source>2302-9285</dc:source><dc:language>en</dc:language><dc:relation>https://beei.org/index.php/EEI/article/download/7853/3882</dc:relation><dc:rights>https://creativecommons.org/licenses/by-sa/4.0/</dc:rights></oai_dc:dc>