Open access
Journal
SINTA 1
Image captioning to aid blind and visually impaired outdoor navigation
IAES International Journal of Artificial Intelligence · Vol. 12 No. 3 (2023) · pp. 1104–1117
ISSN 2252-8938, 2089-4872
Published 2023-09-01
Publisher Institute of Advanced Engineering and Science
Language eng
Abstract
Artificial intelligence technology has dramatically improved the quality of services for human needs, one of which is technology to improve the quality of services for the blind and visually impaired, particularly technology that can help them understand visual sights to facilitate navigation in their daily lives. This study developed an image captioning model to aid the blind and visually impaired in outdoor navigation. The image captioning model employs the encoder-decoder method, with the convolutional neural network (CNN) feature extraction and attention layer as encoders and the long short-term memory (LSTM) as decoders. ResNet101 and ResNet152 are used in the encoder to extract image features. The results of the extraction and caption are forwarded to the attention layer and the LSTM network. The attention layer uses the Bahdanau attention mechanism. The accuracy of the model is calculated using the bilingual evaluation understudy score (BLEU), metric for evaluation of translation with explicit ordering (METEOR) and recall-oriented understudy for gisting evaluation-longest common subsequence (ROUGE-L). ResNet101 performed the best on BLEU-4, scoring 91.811% and 94.0337% in the METEOR evaluation. The captioning results show that the model is quite successful in displaying a simple caption that is suitable for each image.
Collaboration network of the authors
14 authors ·
31 co-authorship links
Hover or tap a name to highlight its co-authors. Double-click to open the author's page.
University of Bengkulu Affiliation unknown
Different organisations
Same organisation
Affiliation unknown
Thicker line = more joint articles · bigger circle = more articles
Show as table
Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.
Metadata source: OAI-PMH (metadata jurnal) http://ijai.iaescore.com/index.php/IJAI/oai, first harvested 8 Nov 2026, last seen 16 Nov 2026.
Original metadata (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
<dc:title xml:lang="en-US">Image captioning to aid blind and visually impaired outdoor navigation</dc:title>
<dc:creator>Faurina, Ruvita</dc:creator>
<dc:creator>Jelita, Anisa</dc:creator>
<dc:creator>Vatresia, Arie</dc:creator>
<dc:creator>Agustian, Indra</dc:creator>
<dc:subject xml:lang="en-US">Computer and Informatics; Artificial Intelligence</dc:subject>
<dc:subject xml:lang="en-US">Attention mechanism; Convolutional neural network; Image captioning; Long short-term memory; Visually impaired</dc:subject>
<dc:description xml:lang="en-US">Artificial intelligence technology has dramatically improved the quality of services for human needs, one of which is technology to improve the quality of services for the blind and visually impaired, particularly technology that can help them understand visual sights to facilitate navigation in their daily lives. This study developed an image captioning model to aid the blind and visually impaired in outdoor navigation. The image captioning model employs the encoder-decoder method, with the convolutional neural network (CNN) feature extraction and attention layer as encoders and the long short-term memory (LSTM) as decoders. ResNet101 and ResNet152 are used in the encoder to extract image features. The results of the extraction and caption are forwarded to the attention layer and the LSTM network. The attention layer uses the Bahdanau attention mechanism. The accuracy of the model is calculated using the bilingual evaluation understudy score (BLEU), metric for evaluation of translation with explicit ordering (METEOR) and recall-oriented understudy for gisting evaluation-longest common subsequence (ROUGE-L). ResNet101 performed the best on BLEU-4, scoring 91.811% and 94.0337% in the METEOR evaluation. The captioning results show that the model is quite successful in displaying a simple caption that is suitable for each image.</dc:description>
<dc:publisher xml:lang="en-US">Institute of Advanced Engineering and Science</dc:publisher>
<dc:contributor xml:lang="en-US"></dc:contributor>
<dc:date>2023-09-01</dc:date>
<dc:type>info:eu-repo/semantics/article</dc:type>
<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
<dc:type xml:lang="en-US"></dc:type>
<dc:format>application/pdf</dc:format>
<dc:identifier>https://ijai.iaescore.com/index.php/IJAI/article/view/22587</dc:identifier>
<dc:identifier>10.11591/ijai.v12.i3.pp1104-1117</dc:identifier>
<dc:source xml:lang="en-US">IAES International Journal of Artificial Intelligence (IJ-AI); Vol 12, No 3: September 2023; 1104-1117</dc:source>
<dc:source>2252-8938</dc:source>
<dc:source>2089-4872</dc:source>
<dc:source>10.11591/ijai.v12.i3</dc:source>
<dc:language>eng</dc:language>
<dc:relation>https://ijai.iaescore.com/index.php/IJAI/article/view/22587/13681</dc:relation>
<dc:relation>https://ijai.iaescore.com/index.php/IJAI/article/downloadSuppFile/22587/3113</dc:relation>
<dc:relation>https://ijai.iaescore.com/index.php/IJAI/article/downloadSuppFile/22587/3122</dc:relation>
<dc:rights xml:lang="en-US">Copyright (c) 2023 Institute of Advanced Engineering and Science</dc:rights>
<dc:rights xml:lang="en-US">http://creativecommons.org/licenses/by-sa/4.0</dc:rights>
</oai_dc:dc>
Citations and indexing
OpenAlex
Indexed
via DOI
9 citations
Crossref
Indexed
via DOI
5 citations
Counts as reported by each index on 13 Nov 2026; indexes count citations differently.
OpenAlex also lists this work in: crossref.
Cite this article
APA 7
Faurina, R., Jelita, A., Vatresia, A., & Agustian, I. (2023). Image captioning to aid blind and visually impaired outdoor navigation. IAES International Journal of Artificial Intelligence, 12(3), 1104–1117. https://doi.org/10.11591/ijai.v12.i3.pp1104-1117
Copy
IEEE
R. Faurina, A. Jelita, A. Vatresia, and I. Agustian, “Image captioning to aid blind and visually impaired outdoor navigation,” IAES International Journal of Artificial Intelligence, vol. 12, no. 3, pp. 1104–1117, 2023, doi: 10.11591/ijai.v12.i3.pp1104-1117.
Copy
Generated from the journal's metadata; check author names before use.