Melola Discovery

← Melola Discovery

Jurnal SINTA 1

DESIGNING TRANSLATION TOOL: BETWEEN SIGN LANGUAGE TO SPOKEN TEXT ON KINECT TIME SERIES DATA USING DYNAMIC TIME WARPING

Sinergi · Vol. 22 No. 2 (2018) · hlm. 91–100

DOI
10.22441/sinergi.2018.2.004
ISSN
2460-1217, 1410-2331
Terbit
2018-06-27
Penerbit
Universitas Mercu Buana
Bahasa
eng

Abstrak

The gesture is one of the most natural and expressive methods for the hearing impaired. Most researchers, however, focus on either static gestures, postures or a small group of dynamic gestures due to the complexity of dynamic gestures. We propose the Kinect Translation Tool to recognize the user's gesture. As a result, the Kinect Translation Tool can be used for bilateral communication with the deaf community. Since real-time detection of a large number of dynamic gestures is taken into account, some efficient algorithms and models are required. The dynamic time warping algorithm is used here to detect and translate the gesture. Kinect Sign Language should translate sign language into written and spoken words. Conversely, people can reply directly with their spoken word, which is converted into literal text together with the animated 3D sign language gestures. The user study, which included several prototypes of the user interface, was carried out with the observation of ten participants who had to gesture and spell the phrases in American Sign Language (ASL). The speech recognition tests for simple phrases have therefore shown good results. The system also recognized the participant's gesture very well during the test. The study suggested that a natural user interface with Microsoft Kinect could be interpreted as a sign language translator for the hearing impaired.

Kata kunci

Jaringan kolaborasi para penulis

11 penulis · 21 tautan kepenulisan bersama · 14 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Universitas Nusa Mandiri
  • Mercu Buana University
  • National University of Malaysia
  • Universitas Budi Luhur
  • Universitas Putra Indonesia "YPTK"
  • Afiliasi tidak diketahui
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Fadlan Hamid AlfebiUniversitas Nusa Mandiri1
Anton NoviantoUniversitas Nusa Mandiri1
Kasiful ApriantoUniversitas Nusa Mandiri1
Samidi SamidiUniversitas Budi Luhur1
Ruci MeiyantiMercu Buana University1
Rabiah Abdul KadirNational University of Malaysia1
Gushelmi GushelmiUniversitas Putra Indonesia "YPTK"1
Azlina AhmadNational University of Malaysia1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) https://publikasi.mercubuana.ac.id/index.php/sinergi/oai, pertama di-harvest 10 Nov 2026, terakhir terlihat 16 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">DESIGNING TRANSLATION TOOL:  BETWEEN SIGN LANGUAGE TO SPOKEN TEXT ON  KINECT TIME SERIES DATA USING DYNAMIC TIME WARPING</dc:title>
	<dc:creator>Putera, Zico Pratama</dc:creator>
	<dc:creator>Anasanti, Mila Desi</dc:creator>
	<dc:creator>Priambodo, Bagus</dc:creator>
	<dc:subject xml:lang="en-US">Human-Computer Interaction</dc:subject>
	<dc:subject xml:lang="en-US">Natural User Interface</dc:subject>
	<dc:subject xml:lang="en-US">Speech Recognition</dc:subject>
	<dc:subject xml:lang="en-US">3D Animation</dc:subject>
	<dc:subject xml:lang="en-US">Sign Language</dc:subject>
	<dc:description xml:lang="en-US">The gesture is one of the most natural and expressive methods for the hearing impaired. Most researchers, however, focus on either static gestures, postures or a small group of dynamic gestures due to the complexity of dynamic gestures. We propose the Kinect Translation Tool to recognize the user's gesture. As a result, the Kinect Translation Tool can be used for bilateral communication with the deaf community. Since real-time detection of a large number of dynamic gestures is taken into account, some efficient algorithms and models are required. The dynamic time warping algorithm is used here to detect and translate the gesture. Kinect Sign Language should translate sign language into written and spoken words. Conversely, people can reply directly with their spoken word, which is converted into literal text together with the animated 3D sign language gestures. The user study, which included several prototypes of the user interface, was carried out with the observation of ten participants who had to gesture and spell the phrases in American Sign Language (ASL). The speech recognition tests for simple phrases have therefore shown good results. The system also recognized the participant's gesture very well during the test. The study suggested that a natural user interface with Microsoft Kinect could be interpreted as a sign language translator for the hearing impaired.</dc:description>
	<dc:publisher xml:lang="en-US">Universitas Mercu Buana</dc:publisher>
	<dc:date>2018-06-27</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://publikasi.mercubuana.ac.id/index.php/sinergi/article/view/2635</dc:identifier>
	<dc:identifier>10.22441/sinergi.2018.2.004</dc:identifier>
	<dc:source xml:lang="en-US">SINERGI; Vol. 22 No. 2 (2018); 91-100</dc:source>
	<dc:source>2460-1217</dc:source>
	<dc:source>1410-2331</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://publikasi.mercubuana.ac.id/index.php/sinergi/article/view/2635/1724</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2018 SINERGI</dc:rights>
</oai_dc:dc>