Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Control Home Appliances Using Hand Gesture Recognition Based on Deep Learning and Arduino Uno via Infrared Signal

Journal of Robotics and Control (JRC) · Vol. 6 No. 6 (2025) · hlm. 2628–2644

DOI
10.18196/jrc.v6i6.27924
ISSN
2715-5072, 2715-5056
Terbit
2025-11-07
Penerbit
Universitas Muhammadiyah Yogyakarta
Bahasa
eng
Lisensi
creativecommons.org/licenses/by-sa/4.0

Abstrak

Currently, deep learning (DL) has been applied to various fields of reality and yielded very convincing results, especially in problems related to computer vision and natural language processing. Controlling devices with AI technologies is not a new problem, but there are still challenges in terms of accuracy, latency, and application in conditions of low-configuration, low-cost devices, and low-quality input data. In this paper, we conduct research on proposing a solution to build a system to control devices in smart homes (Samsung TV, the Daikin air conditioner, and the Vinawind fan) using hand gesture recognition (HGR). Our proposed system includes the step of building control commands (6 gestures corresponding to 6 control commands) and connecting, sending commands to execute control commands using Arduino UNO via infrared signals to the device. The process of creating commands is based on using YOLOv11 for HRG. Choosing YOLOv11 is based on comparative research on HGR results with the methods: Mediapipe, YOLOv11, YOLOv12, MobileNetV3-Large, Transformer-Based Network (TBN), Multiscale Video Transformer Network (MVTN), and GestFormer. YOLOv11 has near-perfect accuracy (acc=99.5%, P=99.3%, R=99.9%, and F1 − score=99.6%), and YOLOv11 is capable of working well with low-configuration computers, and calculations are performed on the CPU. The delays in device control for Samsung TV, Daikin air conditioner, and Vinawind fan are 0.14s, 0.18s, and 0.18s, respectively. Our proposed system is capable of operating according to the requirements of reality. The results and demos of the system are readily available.

Kata kunci

Jaringan kolaborasi para penulis

6 penulis · 11 tautan kepenulisan bersama · 1 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Trường Đại học Tân Trào
  • Hanoi University of Science and Technology
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Thi-Loan PhamHanoi University of Science and Technology1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) https://journal.umy.ac.id/index.php/jrc/oai, pertama di-harvest 9 Nov 2026, terakhir terlihat 16 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Control Home Appliances Using Hand Gesture Recognition Based on Deep Learning and Arduino Uno via Infrared Signal</dc:title>
	<dc:creator>Le, Van-Hung</dc:creator>
	<dc:creator>Nguyen, Minh-Quang</dc:creator>
	<dc:creator>Te, Trung-Hieu</dc:creator>
	<dc:creator>Phan, Van-Nam</dc:creator>
	<dc:creator>Do, Huu-Son</dc:creator>
	<dc:subject xml:lang="en-US">Control Home Appliances</dc:subject>
	<dc:subject xml:lang="en-US">Hand Gesture Recognition (Hgr)</dc:subject>
	<dc:subject xml:lang="en-US">Arduino Uno</dc:subject>
	<dc:subject xml:lang="en-US">Deep Learning</dc:subject>
	<dc:subject xml:lang="en-US">Infrared Signal</dc:subject>
	<dc:description xml:lang="en-US">Currently, deep learning (DL) has been applied to various fields of reality and yielded very convincing results, especially in problems related to computer vision and natural language processing. Controlling devices with AI technologies is not a new problem, but there are still challenges in terms of accuracy, latency, and application in conditions of low-configuration, low-cost devices, and low-quality input data. In this paper, we conduct research on proposing a solution to build a system to control devices in smart homes (Samsung TV, the Daikin air conditioner, and the Vinawind fan) using hand gesture recognition (HGR). Our proposed system includes the step of building control commands (6 gestures corresponding to 6 control commands) and connecting, sending commands to execute control commands using Arduino UNO via infrared signals to the device. The process of creating commands is based on using YOLOv11 for HRG. Choosing YOLOv11 is based on comparative research on HGR results with the methods: Mediapipe, YOLOv11, YOLOv12, MobileNetV3-Large, Transformer-Based Network (TBN), Multiscale Video Transformer Network (MVTN), and GestFormer. YOLOv11 has near-perfect accuracy (acc=99.5%, P=99.3%, R=99.9%, and F1 − score=99.6%), and YOLOv11 is capable of working well with low-configuration computers, and calculations are performed on the CPU. The delays in device control for Samsung TV, Daikin air conditioner, and Vinawind fan are 0.14s, 0.18s, and 0.18s, respectively. Our proposed system is capable of operating according to the requirements of reality. The results and demos of the system are readily available.</dc:description>
	<dc:publisher xml:lang="en-US">Universitas Muhammadiyah Yogyakarta</dc:publisher>
	<dc:date>2025-11-07</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.umy.ac.id/index.php/jrc/article/view/27924</dc:identifier>
	<dc:identifier>10.18196/jrc.v6i6.27924</dc:identifier>
	<dc:source xml:lang="en-US">Journal of Robotics and Control (JRC); Vol. 6 No. 6 (2025); 2628-2644</dc:source>
	<dc:source>2715-5072</dc:source>
	<dc:source>2715-5056</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.umy.ac.id/index.php/jrc/article/view/27924/12007</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2025 Van-Hung Le, Minh-Quang Nguyen, Trung-Hieu Te, Van-Nam Phan, Huu-Son Do</dc:rights>
	<dc:rights xml:lang="en-US">https://creativecommons.org/licenses/by-sa/4.0</dc:rights>
</oai_dc:dc>