Jurnal SINTA 1
Bengali Word Detection from Lip Movements Using Mask RCNN and Generalized Linear Model
Indonesian Journal of Electical Engineering and Informatics (IJEEI) · Vol. 12 No. 2 (2024) · hlm. 373–383
- ISSN
- 2089-3272, 2089-3272
- Terbit
- 2024-06-28
- Penerbit
- IAES Indonesian Section
- Bahasa
- en
Abstrak
Speech processing with the help of lip detection and lip reading is an advancing field. For this, we need proper algorithms and techniques to detect lips and movements of lips perfectly. Lip detection and configuration are the most important parts of speech recognition. In this paper, we focus on detecting the lip segment properly. Mask R-CNN (Regional Convolutional Neural Network) performs object detection and instance segmentation per video frame to detect the lip segment. The process of mask R-CNN adds only a small overhead to Faster R-CNN and is quite simple to train, running at 5 frames per second. The Mask R-CNN involves keypoint detection which helps to extract the location of the lip landmarks pixel by pixel. Once the lip region is extracted and the landmarks are highlighted, we observe how the lip landmarks change as the object's lips move over time to each Bengali word. The keypoint changes that are observed during each millisecond are then the landmarks used to train the GLM (Generalized Linear Model). In addition, we compare the performance of GLM with Naive Bayes, Logistic Regression, and Decision Tree. The GLM has exhibited the highest 91.8% accuracy, whereas the Naive Bayes, Logistic Regression, and Decision Tree show the accuracy of 87.1%, 38.3%, and 82.2%, respectively.
Kata kunci
Jaringan kolaborasi para penulis
40 penulis · 91 tautan kepenulisan bersama · 57 lintas organisasi · menampilkan 40 yang paling banyak terhubung
Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.
- BRAC University
- University of Technology Malaysia
- Chittagong University of Engineering & Technology
- Woosong University
- Hankuk University of Foreign Studies
- Multimedia University
- Bangladesh University of Business and Technology
- Organisasi lain
- Afiliasi tidak diketahui
- Organisasi berbeda
- Organisasi sama
- Afiliasi tidak diketahui
- Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
| Rekan penulis | Organisasi | Artikel bersama |
|---|---|---|
| Md. Monirul Islam | Hankuk University of Foreign Studies | 4 |
| Md Roman Bhuiyan | Multimedia University | 2 |
| Faisal Bin Al Abid | University of Technology Malaysia | 2 |
| Aryati Binti Bakri | University of Technology Malaysia | 2 |
| Shefayatuj Johara Chowdhury | Bangladesh University of Business and Technology | 2 |
| Rubel Biswas | BRAC University | 1 |
| Md Junayed Hasan | BRAC University | 1 |
| Nibras Ar Rakib | BRAC University | 1 |
| SM Zamshed Farhan | Afiliasi tidak diketahui | 1 |
| Md. Mashrur Bari Sobhan | BRAC University | 1 |
| Arafat Habib | BRAC University | 1 |
| Rafid Ahmed | BRAC University | 1 |
| Md. Sazzadul Islam | BRAC University | 1 |
| Fabian Parsia George | BRAC University | 1 |
| Istiaque Mannafee Shaikat | BRAC University | 1 |
| Prommy Sultana Hossain | BRAC University | 1 |
| Mohammad Zavid Parvez | BRAC University | 1 |
| Amitabha Chakrabarty | BRAC University | 1 |
| Zannatul Ferdoush | BRAC University | 1 |
| Booshra Nazifa Mahmud | BRAC University | 1 |
| Mohammad Abul Kashem | University of Dhaka | 1 |
| Md. Hasan Furhad | Afiliasi tidak diketahui | 1 |
| Ripon Kumar Chakrabortty | UNSW Canberra | 1 |
| Michael J. Ryan | Afiliasi tidak diketahui | 1 |
| Iqbal Hasan Sarker | Chittagong University of Engineering & Technology | 1 |
| Mohammod Abul Kashem | Dhaka University of Engineering & Technology | 1 |
| Shabbir Ahmad | Afiliasi tidak diketahui | 1 |
| Md. Golam Rabiul Alam | BRAC University | 1 |
| Tasnim Sakib Apon | BRAC University | 1 |
| Md. Saiful Islam | Chittagong University of Engineering & Technology | 1 |
| Mohammad Mohiuddin | Chittagong University of Engineering & Technology | 1 |
| Hasin Jawad Ali | Islamic University of Technology | 1 |
| Darmawan Satyananda | University of Technology Malaysia | 1 |
| Ferdaus Anam Jibon | International University of Business Agriculture and Technology | 1 |
| Kingkar Prosad Ghosh | R. P. Shaha University | 1 |
| Shahina Haque | Daffodil International University | 1 |
| Md. Suhag Ali | Jahangirnagar University | 1 |
| Shatabdi Sarker | American International University-Bangladesh | 1 |
Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.