Jurnal
SINTA 2
Improving Recognition of SIBI Gesture by Combining Skeleton and Hand Shape Features
Jurnal Ilmu Komputer dan Informasi (JIKI) · Vol. 15 No. 2 (2022) · hlm. 69–79
ISSN 2502-9274, 2088-7051
Terbit 2022-07-02
Penerbit Faculty of Computer Science - Universitas Indonesia
Bahasa eng
Abstrak
SIBI (Sign System for Indonesian Language) is an official sign language system used in school for hearing impairment students in Indonesia. This work uses the skeleton and hand shape features to classify SIBI gestures. In order to improve the performance of the gesture classification system, we tried to fuse the features in several different ways. The accuracy results achieved by the feature fusion methods are, in descending order of accuracy: 88.016%, when using sequence-feature-vector concatenation, 85.448% when using Conneau feature vector concatenation, 83.723% when using feature-vector concatenation, and 49.618% when using simple feature concatenation. The sequence-feature-vector concatenation techniques yield noticeably better results than those achieved using single features (82.849% with skeleton feature only, 55.530% for the hand shape feature only). The experiment results show that the combined features of the whole gesture sequence can better distinguish one gesture from another in SIBI than the combined features of each gesture frame. In addition to finding the best feature combination technique, this study also found the most suitable Recurrent Neural Network (RNN) model for recognizing SIBI. The models tested are 1-layer, 2-layer LSTM, and GRU. The experimental results show that the 2-layer bidirectional LSTM has the best performance.
Jaringan kolaborasi para penulis
3 penulis ·
2 tautan kepenulisan bersama
Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.
University of Indonesia Afiliasi tidak diketahui
Organisasi berbeda
Organisasi sama
Afiliasi tidak diketahui
Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulis Organisasi Artikel bersama
Misael Jonathan University of Indonesia 1
Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.
Sumber metadata: OAI-PMH (metadata jurnal) https://jiki.cs.ui.ac.id/index.php/jiki/oai, pertama di-harvest 26 Okt 2026, terakhir terlihat 15 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
<dc:title xml:lang="en-US">Improving Recognition of SIBI Gesture by Combining Skeleton and Hand Shape Features</dc:title>
<dc:creator>Rakun, Erdefi</dc:creator>
<dc:creator>Setyono, Noer FP</dc:creator>
<dc:subject xml:lang="en-US">SIBI</dc:subject>
<dc:subject xml:lang="en-US">Long Short Term Memory</dc:subject>
<dc:subject xml:lang="en-US">Gated Recurrent Unit</dc:subject>
<dc:subject xml:lang="en-US">Feature Concatenation</dc:subject>
<dc:description xml:lang="en-US">SIBI (Sign System for Indonesian Language) is an official sign language system used in school for hearing impairment students in Indonesia. This work uses the skeleton and hand shape features to classify SIBI gestures. In order to improve the performance of the gesture classification system, we tried to fuse the features in several different ways. The accuracy results achieved by the feature fusion methods are, in descending order of accuracy: 88.016%, when using sequence-feature-vector concatenation, 85.448% when using Conneau feature vector concatenation, 83.723% when using feature-vector concatenation, and 49.618% when using simple feature concatenation. The sequence-feature-vector concatenation techniques yield noticeably better results than those achieved using single features (82.849% with skeleton feature only, 55.530% for the hand shape feature only). The experiment results show that the combined features of the whole gesture sequence can better distinguish one gesture from another in SIBI than the combined features of each gesture frame. In addition to finding the best feature combination technique, this study also found the most suitable Recurrent Neural Network (RNN) model for recognizing SIBI. The models tested are 1-layer, 2-layer LSTM, and GRU. The experimental results show that the 2-layer bidirectional LSTM has the best performance.</dc:description>
<dc:publisher xml:lang="en-US">Faculty of Computer Science - Universitas Indonesia</dc:publisher>
<dc:date>2022-07-02</dc:date>
<dc:type>info:eu-repo/semantics/article</dc:type>
<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
<dc:format>application/pdf</dc:format>
<dc:format>application/vnd.openxmlformats-officedocument.wordprocessingml.document</dc:format>
<dc:identifier>https://jiki.cs.ui.ac.id/index.php/jiki/article/view/1014</dc:identifier>
<dc:identifier>10.21609/jiki.v15i2.1014</dc:identifier>
<dc:source xml:lang="en-US">Jurnal Ilmu Komputer dan Informasi; Vol. 15 No. 2 (2022): Jurnal Ilmu Komputer dan Informasi (Journal of Computer Science and Information); 69-79</dc:source>
<dc:source>2502-9274</dc:source>
<dc:source>2088-7051</dc:source>
<dc:source>10.21609/jiki.v15i2</dc:source>
<dc:language>eng</dc:language>
<dc:relation>https://jiki.cs.ui.ac.id/index.php/jiki/article/view/1014/460</dc:relation>
<dc:relation>https://jiki.cs.ui.ac.id/index.php/jiki/article/view/1014/482</dc:relation>
<dc:rights xml:lang="en-US">Copyright (c) 2022 Jurnal Ilmu Komputer dan Informasi</dc:rights>
</oai_dc:dc>
Sitasi dan pengindeksan
Jumlah menurut tiap indeks pada 26 Okt 2026; setiap indeks menghitung sitasi dengan cara berbeda.
OpenAlex juga mencatat karya ini di: crossref, doaj.
Sitasi artikel ini
APA 7
Rakun, E., & Setyono, N. F. (2022). Improving Recognition of SIBI Gesture by Combining Skeleton and Hand Shape Features. Jurnal Ilmu Komputer dan Informasi (JIKI), 15(2), 69–79. https://doi.org/10.21609/jiki.v15i2.1014
Salin
IEEE
E. Rakun and N. F. Setyono, “Improving Recognition of SIBI Gesture by Combining Skeleton and Hand Shape Features,” Jurnal Ilmu Komputer dan Informasi (JIKI), vol. 15, no. 2, pp. 69–79, 2022, doi: 10.21609/jiki.v15i2.1014.
Salin
Dibuat dari metadata jurnal; periksa nama penulis sebelum dipakai.