Open access Journal SINTA 1
A Lightweight Landmark-Based Model for Bahasa Lip-Reading Using Attention-BiLSTM
Journal of Information Systems Engineering and Business Intelligence · Vol. 12 No. 2 (2026) · pp. 269–282
- ISSN
- 2443-2555, 2598-6333
- Published
- 2026-07-07
- Publisher
- Universitas Airlangga
- Language
- eng
Abstract
Background: Most lip-reading studies primarily utilize image-based representations of lip movements, offering extensive visual data while imposing significant computational burdens. Lip landmark-based representations are still not well understood, even though they could be a better way to describe lip dynamics in a smaller and more efficient way. This limitation is even more apparent in Bahasa lip-reading research, where there are few studies and computationally efficient solutions remain essential. Objective: This study examines the shortcomings of image-based lip-reading methods by leveraging lip landmarks as a concise and computationally efficient input representation. The proposed method is tested on the IndoLR open dataset, which contains video data of lip-reading in Bahasa. Methods: In this study, video sequences were transformed into coordinate-based landmark data to minimize computational demands while preserving critical information regarding lip dynamics. An attention-based BiLSTM model was trained to group10 word classes and 4 phrase classes using this dataset. Results: The model achieved accuracies of 93.03% for word classification and 95.18% for phrase classification. The approach also maintained high efficiency, with average inference times of 0.000530 and 0.011366 s per sample and computational costs of only 0.01 and 0.14 GFLOPs, respectively. Conclusion: These results show how well lip landmarks can be combined with a lightweight deep learning model with very few resources. This study makes a significant contribution to research on lip-reading in Bahasa and lays the groundwork for future studies that will use larger and more diverse datasets. Keywords: Attention, BiLSTM, Bahasa, Landmark, Lip-Reading
Collaboration network of the authors
23 authors · 45 co-authorship links · 8 across different organisations
Hover or tap a name to highlight its co-authors. Double-click to open the author's page.
- Universitas Gadjah Mada
- University of Bengkulu
- Telkom University
- Universitas Islam Negeri Imam Bonjol Padang
- Affiliation unknown
- Different organisations
- Same organisation
- Affiliation unknown
- Thicker line = more joint articles · bigger circle = more articles
Show as table
| Co-author | Organisation | Joint articles |
|---|---|---|
| I Wayan Mustika | Universitas Gadjah Mada | 4 |
| Anggun Fitrian Isnawati | Universitas Gadjah Mada | 3 |
| Selo Sulistyo | Universitas Gadjah Mada | 3 |
| Hanung Adi Nugroho | Universitas Gadjah Mada | 3 |
| Arie Vatresia | University of Bengkulu | 2 |
| Mohammad Yanuar Hariyawan | Affiliation unknown | 2 |
| Eka Firmansyah | Universitas Gadjah Mada | 2 |
| Achmad Rizal | Telkom University | 2 |
| Gusman Wijaya | University of Bengkulu | 1 |
| Ruvita Faurina | University of Bengkulu | 1 |
| Lasmadi Lasmadi | Universitas Gadjah Mada | 1 |
| Adha Imam Cahyadi | Universitas Gadjah Mada | 1 |
| Samiadji Herdjunanto | Universitas Gadjah Mada | 1 |
| Budi Setiyanto | Universitas Gadjah Mada | 1 |
| Sunarno Sunarno | Universitas Gadjah Mada | 1 |
| Willy Anugrah Cahyadi | Telkom University | 1 |
| Raden Muhammad Hilmi Nurhadi | University of Bengkulu | 1 |
| Aulia Arham | Universitas Islam Negeri Imam Bonjol Padang | 1 |
| Rendra Regen Rais | Affiliation unknown | 1 |
| Widhia Oktariani | University of Bengkulu | 1 |
Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.