Akses terbuka
Jurnal
SINTA 1
SeeAround: an offline mobile live support system for the visually impaired
Bulletin of Electrical Engineering and Informatics · Vol. 14 No. 1 (2024) · hlm. 485–504
ISSN 2089-3191, 2302-9285
Terbit 2024-11-22
Penerbit Institute of Advanced Engineering and Science (IAES)
Bahasa en
Abstrak
The inability of blind or partially-sighted people to understand visual content and real-life situations reduces their standard of living, especially in a world mainly tailored for sighted individuals. Despite the progress made by certain devices to assist them in using touch, sound, or other senses, these solutions often fall short of bridging the comprehension gap. Our work proposes an intuitive, user-friendly mobile-based framework named "SeeAround" that is capable of automatically providing real-time audio descriptions of the user's immediate visual surroundings. Our solution addresses this challenge by leveraging key point detection, image captioning, text-to-speech (TTS), optical character recognition (OCR), and translation algorithms to offer comprehensive support for visually impaired individuals. Our system architecture relies on convolutional neural networks (CNNs) such as Inception-V3, Inception-V4, and ResNet152-V2 to extract detailed features from images and employs a multi-gated recurrent unit (GRU) decoder to generate word-by-word natural language descriptions. Our framework was integrated into mobile applications and optimized with TensorFlow lite pre-trained models for easy integration on the Android platform.
Jaringan kolaborasi para penulis
6 penulis ·
9 tautan kepenulisan bersama
· 2 lintas organisasi
Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.
Sidi Mohamed Ben Abdellah University Pôle Léonard de Vinci
Organisasi berbeda
Organisasi sama
Afiliasi tidak diketahui
Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.
Sumber metadata: OpenAlex API (jurnal SINTA, ADR 0048) https://openalex.org/S2765016208, pertama di-harvest 19 Nov 2026, terakhir terlihat 19 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/"><dc:title xml:lang="en">SeeAround: an offline mobile live support system for the visually impaired</dc:title><dc:creator>Othmane Sebban</dc:creator><dc:creator>Ahmed Azough</dc:creator><dc:creator>Mohamed Lamrini</dc:creator><dc:subject>visually impaired people</dc:subject><dc:subject>audio description</dc:subject><dc:subject>mobile assistive technology</dc:subject><dc:subject>image captioning</dc:subject><dc:subject>keypoint detection</dc:subject><dc:subject>optical character recognition</dc:subject><dc:subject>text-to-speech</dc:subject><dc:subject>translation</dc:subject><dc:subject>convolutional neural networks</dc:subject><dc:subject>TensorFlow Lite</dc:subject><dc:subject>Android application</dc:subject><dc:description xml:lang="en">The inability of blind or partially-sighted people to understand visual content and real-life situations reduces their standard of living, especially in a world mainly tailored for sighted individuals. Despite the progress made by certain devices to assist them in using touch, sound, or other senses, these solutions often fall short of bridging the comprehension gap. Our work proposes an intuitive, user-friendly mobile-based framework named "SeeAround" that is capable of automatically providing real-time audio descriptions of the user's immediate visual surroundings. Our solution addresses this challenge by leveraging key point detection, image captioning, text-to-speech (TTS), optical character recognition (OCR), and translation algorithms to offer comprehensive support for visually impaired individuals. Our system architecture relies on convolutional neural networks (CNNs) such as Inception-V3, Inception-V4, and ResNet152-V2 to extract detailed features from images and employs a multi-gated recurrent unit (GRU) decoder to generate word-by-word natural language descriptions. Our framework was integrated into mobile applications and optimized with TensorFlow lite pre-trained models for easy integration on the Android platform.</dc:description><dc:publisher>Institute of Advanced Engineering and Science (IAES)</dc:publisher><dc:date>2024-11-22</dc:date><dc:type>info:eu-repo/semantics/article</dc:type><dc:format>application/pdf</dc:format><dc:identifier>https://doi.org/10.11591/eei.v14i1.7904</dc:identifier><dc:identifier>10.11591/eei.v14i1.7904</dc:identifier><dc:source>Bulletin of Electrical Engineering and Informatics; Vol 14 No 1 (2024); 485-504</dc:source><dc:source>2089-3191</dc:source><dc:source>2302-9285</dc:source><dc:language>en</dc:language><dc:relation>https://beei.org/index.php/EEI/article/download/7904/4055</dc:relation><dc:rights>https://creativecommons.org/licenses/by-sa/4.0/</dc:rights></oai_dc:dc>
Sitasi dan pengindeksan
OpenAlex
Terindeks
lewat ID karya OpenAlex (record dari sumber OpenAlex)
0 sitasi
Crossref
Belum diperiksa
Jumlah menurut tiap indeks pada 19 Nov 2026; setiap indeks menghitung sitasi dengan cara berbeda.
OpenAlex juga mencatat karya ini di: crossref.
Sitasi artikel ini
APA 7
Sebban, O., Azough, A., & Lamrini, M. (2024). SeeAround: an offline mobile live support system for the visually impaired. Bulletin of Electrical Engineering and Informatics, 14(1), 485–504. https://doi.org/10.11591/eei.v14i1.7904
Salin
IEEE
O. Sebban, A. Azough, and M. Lamrini, “SeeAround: an offline mobile live support system for the visually impaired,” Bulletin of Electrical Engineering and Informatics, vol. 14, no. 1, pp. 485–504, 2024, doi: 10.11591/eei.v14i1.7904.
Salin
Dibuat dari metadata jurnal; periksa nama penulis sebelum dipakai.