Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

SeeAround: an offline mobile live support system for the visually impaired

Bulletin of Electrical Engineering and Informatics · Vol. 14 No. 1 (2024) · hlm. 485–504

DOI
10.11591/eei.v14i1.7904
ISSN
2089-3191, 2302-9285
Terbit
2024-11-22
Penerbit
Institute of Advanced Engineering and Science (IAES)
Bahasa
en
Lisensi
creativecommons.org/licenses/by-sa/4.0/

Abstrak

The inability of blind or partially-sighted people to understand visual content and real-life situations reduces their standard of living, especially in a world mainly tailored for sighted individuals. Despite the progress made by certain devices to assist them in using touch, sound, or other senses, these solutions often fall short of bridging the comprehension gap. Our work proposes an intuitive, user-friendly mobile-based framework named "SeeAround" that is capable of automatically providing real-time audio descriptions of the user's immediate visual surroundings. Our solution addresses this challenge by leveraging key point detection, image captioning, text-to-speech (TTS), optical character recognition (OCR), and translation algorithms to offer comprehensive support for visually impaired individuals. Our system architecture relies on convolutional neural networks (CNNs) such as Inception-V3, Inception-V4, and ResNet152-V2 to extract detailed features from images and employs a multi-gated recurrent unit (GRU) decoder to generate word-by-word natural language descriptions. Our framework was integrated into mobile applications and optimized with TensorFlow lite pre-trained models for easy integration on the Android platform.

Kata kunci

Jaringan kolaborasi para penulis

6 penulis · 9 tautan kepenulisan bersama · 2 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Sidi Mohamed Ben Abdellah University
  • Pôle Léonard de Vinci
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Mohamed Taj BennaniSidi Mohamed Ben Abdellah University1
Mohamed El MahjoubySidi Mohamed Ben Abdellah University1
Mohamed El FarSidi Mohamed Ben Abdellah University1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OpenAlex API (jurnal SINTA, ADR 0048) https://openalex.org/S2765016208, pertama di-harvest 19 Nov 2026, terakhir terlihat 19 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/"><dc:title xml:lang="en">SeeAround: an offline mobile live support system for the visually impaired</dc:title><dc:creator>Othmane Sebban</dc:creator><dc:creator>Ahmed Azough</dc:creator><dc:creator>Mohamed Lamrini</dc:creator><dc:subject>visually impaired people</dc:subject><dc:subject>audio description</dc:subject><dc:subject>mobile assistive technology</dc:subject><dc:subject>image captioning</dc:subject><dc:subject>keypoint detection</dc:subject><dc:subject>optical character recognition</dc:subject><dc:subject>text-to-speech</dc:subject><dc:subject>translation</dc:subject><dc:subject>convolutional neural networks</dc:subject><dc:subject>TensorFlow Lite</dc:subject><dc:subject>Android application</dc:subject><dc:description xml:lang="en">The inability of blind or partially-sighted people to understand visual content and real-life situations reduces their standard of living, especially in a world mainly tailored for sighted individuals. Despite the progress made by certain devices to assist them in using touch, sound, or other senses, these solutions often fall short of bridging the comprehension gap. Our work proposes an intuitive, user-friendly mobile-based framework named "SeeAround" that is capable of automatically providing real-time audio descriptions of the user's immediate visual surroundings. Our solution addresses this challenge by leveraging key point detection, image captioning, text-to-speech (TTS), optical character recognition (OCR), and translation algorithms to offer comprehensive support for visually impaired individuals. Our system architecture relies on convolutional neural networks (CNNs) such as Inception-V3, Inception-V4, and ResNet152-V2 to extract detailed features from images and employs a multi-gated recurrent unit (GRU) decoder to generate word-by-word natural language descriptions. Our framework was integrated into mobile applications and optimized with TensorFlow lite pre-trained models for easy integration on the Android platform.</dc:description><dc:publisher>Institute of Advanced Engineering and Science (IAES)</dc:publisher><dc:date>2024-11-22</dc:date><dc:type>info:eu-repo/semantics/article</dc:type><dc:format>application/pdf</dc:format><dc:identifier>https://doi.org/10.11591/eei.v14i1.7904</dc:identifier><dc:identifier>10.11591/eei.v14i1.7904</dc:identifier><dc:source>Bulletin of Electrical Engineering and Informatics; Vol 14 No 1 (2024); 485-504</dc:source><dc:source>2089-3191</dc:source><dc:source>2302-9285</dc:source><dc:language>en</dc:language><dc:relation>https://beei.org/index.php/EEI/article/download/7904/4055</dc:relation><dc:rights>https://creativecommons.org/licenses/by-sa/4.0/</dc:rights></oai_dc:dc>