Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Image captioning to aid blind and visually impaired outdoor navigation

IAES International Journal of Artificial Intelligence · Vol. 12 No. 3 (2023) · hlm. 1104–1117

DOI
10.11591/ijai.v12.i3.pp1104-1117
ISSN
2252-8938, 2089-4872
Terbit
2023-09-01
Penerbit
Institute of Advanced Engineering and Science
Bahasa
eng
Lisensi
creativecommons.org/licenses/by-sa/4.0

Abstrak

Artificial intelligence technology has dramatically improved the quality of services for human needs, one of which is technology to improve the quality of services for the blind and visually impaired, particularly technology that can help them understand visual sights to facilitate navigation in their daily lives. This study developed an image captioning model to aid the blind and visually impaired in outdoor navigation. The image captioning model employs the encoder-decoder method, with the convolutional neural network (CNN) feature extraction and attention layer as encoders and the long short-term memory (LSTM) as decoders. ResNet101 and ResNet152 are used in the encoder to extract image features. The results of the extraction and caption are forwarded to the attention layer and the LSTM network. The attention layer uses the Bahdanau attention mechanism. The accuracy of the model is calculated using the bilingual evaluation understudy score (BLEU), metric for evaluation of translation with explicit ordering (METEOR) and recall-oriented understudy for gisting evaluation-longest common subsequence (ROUGE-L). ResNet101 performed the best on BLEU-4, scoring 91.811% and 94.0337% in the METEOR evaluation. The captioning results show that the model is quite successful in displaying a simple caption that is suitable for each image.

Kata kunci

Jaringan kolaborasi para penulis

14 penulis · 31 tautan kepenulisan bersama

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • University of Bengkulu
  • Afiliasi tidak diketahui
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Ferzha Putra UtamaUniversity of Bengkulu3
Vivin PurnamasariUniversity of Bengkulu3
Gusman WijayaUniversity of Bengkulu2
Novalio DarathaUniversity of Bengkulu2
Bagus Imam PrayogaUniversity of Bengkulu2
Hendy SantosaUniversity of Bengkulu2
Pieters N.P TambunanUniversity of Bengkulu1
Erlanshari AanUniversity of Bengkulu1
Rendra Regen RaisAfiliasi tidak diketahui1
Widhia OktarianiUniversity of Bengkulu1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) http://ijai.iaescore.com/index.php/IJAI/oai, pertama di-harvest 8 Nov 2026, terakhir terlihat 16 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Image captioning to aid blind and visually impaired outdoor navigation</dc:title>
	<dc:creator>Faurina, Ruvita</dc:creator>
	<dc:creator>Jelita, Anisa</dc:creator>
	<dc:creator>Vatresia, Arie</dc:creator>
	<dc:creator>Agustian, Indra</dc:creator>
	<dc:subject xml:lang="en-US">Computer and Informatics; Artificial Intelligence</dc:subject>
	<dc:subject xml:lang="en-US">Attention mechanism; Convolutional neural network; Image captioning; Long short-term memory; Visually impaired</dc:subject>
	<dc:description xml:lang="en-US">Artificial intelligence technology has dramatically improved the quality of services for human needs, one of which is technology to improve the quality of services for the blind and visually impaired, particularly technology that can help them understand visual sights to facilitate navigation in their daily lives. This study developed an image captioning model to aid the blind and visually impaired in outdoor navigation. The image captioning model employs the encoder-decoder method, with the convolutional neural network (CNN) feature extraction and attention layer as encoders and the long short-term memory (LSTM) as decoders. ResNet101 and ResNet152 are used in the encoder to extract image features. The results of the extraction and caption are forwarded to the attention layer and the LSTM network. The attention layer uses the Bahdanau attention mechanism. The accuracy of the model is calculated using the bilingual evaluation understudy score (BLEU), metric for evaluation of translation with explicit ordering (METEOR) and recall-oriented understudy for gisting evaluation-longest common subsequence (ROUGE-L). ResNet101 performed the best on BLEU-4, scoring 91.811% and 94.0337% in the METEOR evaluation. The captioning results show that the model is quite successful in displaying a simple caption that is suitable for each image.</dc:description>
	<dc:publisher xml:lang="en-US">Institute of Advanced Engineering and Science</dc:publisher>
	<dc:contributor xml:lang="en-US"></dc:contributor>
	<dc:date>2023-09-01</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US"></dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://ijai.iaescore.com/index.php/IJAI/article/view/22587</dc:identifier>
	<dc:identifier>10.11591/ijai.v12.i3.pp1104-1117</dc:identifier>
	<dc:source xml:lang="en-US">IAES International Journal of Artificial Intelligence (IJ-AI); Vol 12, No 3: September 2023; 1104-1117</dc:source>
	<dc:source>2252-8938</dc:source>
	<dc:source>2089-4872</dc:source>
	<dc:source>10.11591/ijai.v12.i3</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://ijai.iaescore.com/index.php/IJAI/article/view/22587/13681</dc:relation>
	<dc:relation>https://ijai.iaescore.com/index.php/IJAI/article/downloadSuppFile/22587/3113</dc:relation>
	<dc:relation>https://ijai.iaescore.com/index.php/IJAI/article/downloadSuppFile/22587/3122</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2023 Institute of Advanced Engineering and Science</dc:rights>
	<dc:rights xml:lang="en-US">http://creativecommons.org/licenses/by-sa/4.0</dc:rights>
</oai_dc:dc>