Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Temporal convolutional network for Indonesian word by word sign language translator on MediaPipe framework

IAES International Journal of Artificial Intelligence · Vol. 15 No. 5 (2026) · hlm. 4081–4095

DOI
10.11591/ijai.v15.i5.pp4081-4095
ISSN
2252-8938, 2089-4872
Terbit
2026-10-01
Penerbit
Institute of Advanced Engineering and Science
Bahasa
eng
Lisensi
creativecommons.org/licenses/by-sa/4.0

Abstrak

Sign language is a language created to help the deaf-mute communicate with others. In Indonesia, there are two sign languages: Indonesian sign language system or sistem isyarat bahasa Indonesia (SIBI) and Indonesian sign language or bahasa isyarat Indonesia (BISINDO), but the deaf community prefers to use BISINDO. Deaf-mute people use sign language to communicate, but normal people usually avoid learning it because they feel it's unnecessary for daily communication. This will certainly be a problem for the deaf-mute because people who do not learn sign language will certainly have difficulty understanding what they are trying to convey. Therefore, an application that can translate sign language is needed to help overcome communication problems between the deaf-mute and normal people. This research focuses on BISINDO translation using a temporal convolutional network (TCN) with MediaPipe methods. The amount of data used consists of 2,700 videos representing 27 word-level signs in BISINDO; this number increases to 32,400 after undergoing the data augmentation process. The model built was tested in translating BISINDO at the word level in simulation, and a thorough comparison between TCN and bidirectional long short-term memory (BiLSTM); both of them were running on the MediaPipe platform separately. From the experiment, it is shown that the performance of TCN exceeds BiLSTM with an accuracy rate as high as 88.64%.

Kata kunci

Jaringan kolaborasi para penulis

17 penulis · 60 tautan kepenulisan bersama · 40 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Universitas Sumatera Utara
  • Politeknik Negeri Medan
  • Universitas Muhammadiyah Sumatera Utara
  • UNITAR International University
  • Telkom University
  • Universitas Muhammadiyah Sumatera Barat
  • Media Design School
  • Organisasi lain
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Arif Ridho LubisPoliteknik Negeri Medan5
Al-Khowarizmi Al-KhowarizmiUniversitas Muhammadiyah Sumatera Utara5
Muharman LubisTelkom University3
Mhd Faris PratamaUniversitas Sumatera Utara2
Sharfina FazaPoliteknik Negeri Medan2
Ferry FachrizalPoliteknik Negeri Medan1
Hariyadi HariyadiUniversitas Muhammadiyah Sumatera Barat1
Muhammad BasriUniversitas Halu Oleo1
Michael J. WattsMedia Design School1
Akrim AkrimUniversitas Muhammadiyah Sumatera Utara1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) http://ijai.iaescore.com/index.php/IJAI/oai, pertama di-harvest 8 Nov 2026, terakhir terlihat 16 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Temporal convolutional network for Indonesian word by word sign language translator on MediaPipe framework</dc:title>
	<dc:creator>Purnamawati, Sarah</dc:creator>
	<dc:creator>Albert, Albert</dc:creator>
	<dc:creator>Yohanes Pardede, Anggi</dc:creator>
	<dc:creator>Fakhriza, Iqbal</dc:creator>
	<dc:creator>Nadi, Farhad</dc:creator>
	<dc:creator>Fadly Syahputra, Mohammad</dc:creator>
	<dc:creator>Rahmat, Romi Fadillah</dc:creator>
	<dc:subject xml:lang="en-US"></dc:subject>
	<dc:subject xml:lang="en-US">Deep learning; Hand movement recognition; Language automation; Neural network; Speech-impaired technology</dc:subject>
	<dc:description xml:lang="en-US">Sign language is a language created to help the deaf-mute communicate with others. In Indonesia, there are two sign languages: Indonesian sign language system or sistem isyarat bahasa Indonesia (SIBI) and Indonesian sign language or bahasa isyarat Indonesia (BISINDO), but the deaf community prefers to use BISINDO. Deaf-mute people use sign language to communicate, but normal people usually avoid learning it because they feel it's unnecessary for daily communication. This will certainly be a problem for the deaf-mute because people who do not learn sign language will certainly have difficulty understanding what they are trying to convey. Therefore, an application that can translate sign language is needed to help overcome communication problems between the deaf-mute and normal people. This research focuses on BISINDO translation using a temporal convolutional network (TCN) with MediaPipe methods. The amount of data used consists of 2,700 videos representing 27 word-level signs in BISINDO; this number increases to 32,400 after undergoing the data augmentation process. The model built was tested in translating BISINDO at the word level in simulation, and a thorough comparison between TCN and bidirectional long short-term memory (BiLSTM); both of them were running on the MediaPipe platform separately. From the experiment, it is shown that the performance of TCN exceeds BiLSTM with an accuracy rate as high as 88.64%.</dc:description>
	<dc:publisher xml:lang="en-US">Institute of Advanced Engineering and Science</dc:publisher>
	<dc:contributor xml:lang="en-US"></dc:contributor>
	<dc:date>2026-10-01</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US"></dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://ijai.iaescore.com/index.php/IJAI/article/view/29693</dc:identifier>
	<dc:identifier>10.11591/ijai.v15.i5.pp4081-4095</dc:identifier>
	<dc:source xml:lang="en-US">IAES International Journal of Artificial Intelligence (IJ-AI); Vol 15, No 5: October 2026; 4081-4095</dc:source>
	<dc:source>2252-8938</dc:source>
	<dc:source>2089-4872</dc:source>
	<dc:source>10.11591/ijai.v15.i5</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://ijai.iaescore.com/index.php/IJAI/article/view/29693/15377</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2026 Sarah Purnamawati, Albert, Anggi Yohanes Pardede, Iqbal Fakhriza, Farhad Nadi,  Mohammad Fadly Syahputra, Romi Fadillah Rahmat</dc:rights>
	<dc:rights xml:lang="en-US">http://creativecommons.org/licenses/by-sa/4.0</dc:rights>
</oai_dc:dc>