Jurnal
SINTA 2
Translating SIBI (Sign System for Indonesian Gesture) Gesture-to-Text in Real-Time using a Mobile Device
Journal of ICT Research and Applications (JICTRA) · Vol. 16 No. 3 (2022) · hlm. 259–280
ISSN 2338-5499, 2337-5787
Terbit 2022-12-31
Penerbit DRI - ITB
Bahasa eng
Abstrak
The SIBI gesture translation framework by Rakun was built using a series of machine learning technologies: MobileNetV2 for feature extraction, Conditional Random Field for finding the epenthesis movement frame, and Long Short-Term Memory for word classification. This high computational translation system was previously implemented on a personal computer system, which lacks portability and accessibility. This study implemented the system on a smartphone using an on-device inference method: the translation process is embedded into the smartphone to provide lower latency and zero data usage. The system was then improved using a parallel multi-inference method, which reduced the average translation time by 25%. The final mobile SIBI gesture-to-text translation system achieved a word accuracy of 90.560%, a sentence accuracy of 64%, and an average translation time of 20 seconds.
Jaringan kolaborasi para penulis
3 penulis ·
2 tautan kepenulisan bersama
Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.
University of Indonesia Afiliasi tidak diketahui
Organisasi berbeda
Organisasi sama
Afiliasi tidak diketahui
Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulis Organisasi Artikel bersama
Noer FP Setyono Afiliasi tidak diketahui 1
Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.
Sumber metadata: OAI-PMH (metadata jurnal) https://journals.itb.ac.id/index.php/jictra/oai, pertama di-harvest 26 Okt 2026, terakhir terlihat 15 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
<dc:title xml:lang="en-US">Translating SIBI (Sign System for Indonesian Gesture) Gesture-to-Text in Real-Time using a Mobile Device</dc:title>
<dc:creator>Jonathan, Misael</dc:creator>
<dc:creator>Rakun, Erdefi</dc:creator>
<dc:subject xml:lang="en-US">Android</dc:subject>
<dc:subject xml:lang="en-US">gesture-to-text translation</dc:subject>
<dc:subject xml:lang="en-US">Indonesian sign language recognition</dc:subject>
<dc:subject xml:lang="en-US">TensorFlow</dc:subject>
<dc:subject xml:lang="en-US">mobile application</dc:subject>
<dc:subject xml:lang="en-US">on-device inference</dc:subject>
<dc:description xml:lang="en-US">The SIBI gesture translation framework by Rakun was built using a series of machine learning technologies: MobileNetV2 for feature extraction, Conditional Random Field for finding the epenthesis movement frame, and Long Short-Term Memory for word classification. This high computational translation system was previously implemented on a personal computer system, which lacks portability and accessibility. This study implemented the system on a smartphone using an on-device inference method: the translation process is embedded into the smartphone to provide lower latency and zero data usage. The system was then improved using a parallel multi-inference method, which reduced the average translation time by 25%. The final mobile SIBI gesture-to-text translation system achieved a word accuracy of 90.560%, a sentence accuracy of 64%, and an average translation time of 20 seconds.</dc:description>
<dc:publisher xml:lang="en-US">DRI - ITB</dc:publisher>
<dc:date>2022-12-31</dc:date>
<dc:type>info:eu-repo/semantics/article</dc:type>
<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
<dc:type xml:lang="en-US">Peer-reviewed Article</dc:type>
<dc:format>application/pdf</dc:format>
<dc:identifier>https://journals.itb.ac.id/index.php/jictra/article/view/18544</dc:identifier>
<dc:identifier>10.5614/itbj.ict.res.appl.2022.16.3.5</dc:identifier>
<dc:source xml:lang="en-US">Journal of ICT Research and Applications; Vol. 16 No. 3 (2022); 259-280</dc:source>
<dc:source>2338-5499</dc:source>
<dc:source>2337-5787</dc:source>
<dc:source>10.5614/itbj.ict.res.appl.2022.16.3</dc:source>
<dc:language>eng</dc:language>
<dc:relation>https://journals.itb.ac.id/index.php/jictra/article/view/18544/6072</dc:relation>
<dc:rights xml:lang="en-US">Copyright (c) 2022 Journal of ICT Research and Applications</dc:rights>
</oai_dc:dc>
Sitasi dan pengindeksan
Jumlah menurut tiap indeks pada 26 Okt 2026; setiap indeks menghitung sitasi dengan cara berbeda.
OpenAlex juga mencatat karya ini di: crossref, doaj.
Sitasi artikel ini
APA 7
Jonathan, M., & Rakun, E. (2022). Translating SIBI (Sign System for Indonesian Gesture) Gesture-to-Text in Real-Time using a Mobile Device. Journal of ICT Research and Applications (JICTRA), 16(3), 259–280. https://doi.org/10.5614/itbj.ict.res.appl.2022.16.3.5
Salin
IEEE
M. Jonathan and E. Rakun, “Translating SIBI (Sign System for Indonesian Gesture) Gesture-to-Text in Real-Time using a Mobile Device,” Journal of ICT Research and Applications (JICTRA), vol. 16, no. 3, pp. 259–280, 2022, doi: 10.5614/itbj.ict.res.appl.2022.16.3.5.
Salin
Dibuat dari metadata jurnal; periksa nama penulis sebelum dipakai.