Melola Discovery

← Melola Discovery

Jurnal Tanpa peringkat SINTA

Smart Rupiah Recognition: A Mobile Machine Learning Approach for Visually Impaired Users

Scientific Journal of Informatics · Vol. 12 No. 4 (2025) · hlm. 577–586

DOI
10.15294/sji.v12i4.28930
ISSN
2407-7658, 2460-0040
Terbit
2025-11-19
Penerbit
Universitas Negeri Semarang
Bahasa
eng

Abstrak

Purpose: Despite advances in assistive technology, low-connectivity areas lack reliable solutions for visually impaired individuals, prompting this study to enhance financial autonomy in cash-based economies. This research addresses high fraud risks and the limitations of online tools like Be My Eyes, which fail in areas with only 40% internet access, by developing a 3MB MobileNetV2 model for offline Rupiah denomination recognition on low-end Android devices. Methods: A MobileNetV2-based Convolutional Neural Network, optimized to 3MB via TensorFlow Lite quantization, was trained on 10,855 augmented images (rotation ±30°, flipping, Gaussian noise, σ=0.1). The Kotlin-based application integrates CameraX for 720p video and Bahasa Indonesia text-to-speech, with a “no object” class. The model was tested on 4–8GB RAM devices, validated through usability evaluations with diverse stakeholders. Result: The model achieves 90% accuracy (F1-score 0.90) at 1000 lux, 85% at 60° angles, and 88% for “no object,” with 10ms latency. Self-supervised learning (SimCLR) on 2,000 worn notes improves accuracy by 3% (p < 0.05). Usability evaluations yield 95% session success, with TTS and UI Likert scores of 4.2 and 4.0.. Novelty: The 3MB MobileNetV2 model, with 10ms latency and 15% false positive reduction, outperforms YOLOv5 (500MB, 50ms), Vision Transformer (1GB, 200ms), and YOLOv8 (200MB, 30ms). This model shows potential for cross-currency detection throught preliminary exploration (e.g., USD and euro), which may advance edge AI and financial inclusion in developing nations.

Kata kunci

Jaringan kolaborasi para penulis

7 penulis · 13 tautan kepenulisan bersama

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Universitas Dian Nuswantoro
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Moch Arief SoelemanUniversitas Dian Nuswantoro1
Aris NurhindartoUniversitas Dian Nuswantoro1
Arie NugrohoUniversitas Dian Nuswantoro1
Ricardus Anggi PramunendarUniversitas Dian Nuswantoro1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) https://journal.unnes.ac.id/journals/sji/oai, pertama di-harvest 6 Nov 2026, terakhir terlihat 8 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en">Smart Rupiah Recognition: A Mobile Machine Learning Approach for Visually Impaired Users</dc:title>
	<dc:creator xml:lang="en">Fadlurrahman, Hanan Nadhif</dc:creator>
	<dc:creator xml:lang="en">Affandy, Affandy</dc:creator>
	<dc:creator xml:lang="en">Cahyadi, Dede Faiz</dc:creator>
	<dc:subject xml:lang="en">Currency Recognition</dc:subject>
	<dc:subject xml:lang="en">MobileNet</dc:subject>
	<dc:subject xml:lang="en">TensorFlow Lite</dc:subject>
	<dc:subject xml:lang="en">Visually Impaired</dc:subject>
	<dc:subject xml:lang="en">Text-to-Speech</dc:subject>
	<dc:description xml:lang="en">Purpose: Despite advances in assistive technology, low-connectivity areas lack reliable solutions for visually impaired individuals, prompting this study to enhance financial autonomy in cash-based economies. This research addresses high fraud risks and the limitations of online tools like Be My Eyes, which fail in areas with only 40% internet access, by developing a 3MB MobileNetV2 model for offline Rupiah denomination recognition on low-end Android devices.
Methods: A MobileNetV2-based Convolutional Neural Network, optimized to 3MB via TensorFlow Lite quantization, was trained on 10,855 augmented images (rotation ±30°, flipping, Gaussian noise, σ=0.1). The Kotlin-based application integrates CameraX for 720p video and Bahasa Indonesia text-to-speech, with a “no object” class. The model was tested on 4–8GB RAM devices, validated through usability evaluations with diverse stakeholders.
Result: The model achieves 90% accuracy (F1-score 0.90) at 1000 lux, 85% at &amp;lt;50 lux, 80% at &amp;gt;60° angles, and 88% for “no object,” with 10ms latency. Self-supervised learning (SimCLR) on 2,000 worn notes improves accuracy by 3% (p &amp;lt; 0.05). Usability evaluations yield 95% session success, with TTS and UI Likert scores of 4.2 and 4.0..
Novelty: The 3MB MobileNetV2 model, with 10ms latency and 15% false positive reduction, outperforms YOLOv5 (500MB, 50ms), Vision Transformer (1GB, 200ms), and YOLOv8 (200MB, 30ms). This model shows potential for cross-currency detection throught preliminary exploration (e.g., USD and euro), which may advance edge AI and financial inclusion in developing nations.</dc:description>
	<dc:publisher xml:lang="en">Universitas Negeri Semarang</dc:publisher>
	<dc:date>2025-11-19</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.unnes.ac.id/journals/sji/article/view/28930</dc:identifier>
	<dc:identifier>10.15294/sji.v12i4.28930</dc:identifier>
	<dc:source xml:lang="en">Scientific Journal of Informatics; Vol. 12 No. 4: Special Issue; 577-586</dc:source>
	<dc:source>2407-7658</dc:source>
	<dc:source>2460-0040</dc:source>
	<dc:source>10.15294/sji.v12i4</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.unnes.ac.id/journals/sji/article/view/28930/7400</dc:relation>
	<dc:rights xml:lang="en">Copyright (c) 2025 Scientific Journal of Informatics</dc:rights>
</oai_dc:dc>