Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Indonesian automatic short answer grading system

Bulletin of Electrical Engineering and Informatics · Vol. 11 No. 3 (2022) · hlm. 1586–1603

DOI
10.11591/eei.v11i3.3531
ISSN
2089-3191, 2302-9285
Terbit
2022-05-28
Penerbit
Institute of Advanced Engineering and Science (IAES)
Bahasa
en
Lisensi
creativecommons.org/licenses/by-sa/4.0/

Abstrak

Short answer question is one of the methods used to evaluate student cognitive abilities, including memorizing, designing, and freely expressing answers based on their thoughts. Unfortunately, grading short answers is more complicated than grading multiple choices answers. For that problem, several studies have tried to build an artificial intelligence system called automatic short answer grading (ASAG). We tried to improve the accuracy of the ASAG system at scoring student answers in Indonesian by enhancing the earlier state-of-the-art models and methods. They were the bidirectional encoder representations from transformer (BERT) with fine-tuning approach and ridge regression models utilizing advanced feature extraction. We conducted this study by doing stages of literature review, data set preparation, model development, implementation, and comparison. Using two different ASAG data sets, the best result of this study was an achievement of 0.9508 in pearson’s correlation and 0.4138 in root-mean-square error (RMSE) by the BERT-based model with the fine-tuning approach. This result outperformed the results of the previous studies using the same evaluation metrics. Thus, it proved our ASAG system using the BERT model with fine-tuning approach can improve the accuracy of grading short answers.

Kata kunci

Jaringan kolaborasi para penulis

18 penulis · 33 tautan kepenulisan bersama

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Binus University
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Daniel D. AlbestaBinus University1
Michael JonathanBinus University1
Muhammad JawadBinus University1
Oktovianus HardiawanBinus University1
Kevin AlexanderBinus University1
Rayhan Ardiya DwantaraBinus University1
Raihan Muhammad NaufalBinus University1
Richard AlisonBinus University1
Welly JonathanBinus University1
Rilo Chandra PradanaBinus University1
Angel KarentiaBinus University1
Ryan AdipradanaBinus University1
Bagas Pradipabista NayogaBinus University1
Ryan SuryadiBinus University1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OpenAlex API (jurnal SINTA, ADR 0048) https://openalex.org/S2765016208, pertama di-harvest 19 Nov 2026, terakhir terlihat 19 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/"><dc:title xml:lang="en">Indonesian automatic short answer grading system</dc:title><dc:creator>Heinrich Reagan Salim</dc:creator><dc:creator>Chintya De</dc:creator><dc:creator>Nicholas Daniel Pratamaputra</dc:creator><dc:creator>Derwin Suhartono</dc:creator><dc:subject>automatic short answer grading</dc:subject><dc:subject>short-answer questions</dc:subject><dc:subject>Indonesian language</dc:subject><dc:subject>BERT fine-tuning</dc:subject><dc:subject>ridge regression</dc:subject><dc:subject>automated essay scoring</dc:subject><dc:subject>feature extraction</dc:subject><dc:description xml:lang="en">Short answer question is one of the methods used to evaluate student cognitive abilities, including memorizing, designing, and freely expressing answers based on their thoughts. Unfortunately, grading short answers is more complicated than grading multiple choices answers. For that problem, several studies have tried to build an artificial intelligence system called automatic short answer grading (ASAG). We tried to improve the accuracy of the ASAG system at scoring student answers in Indonesian by enhancing the earlier state-of-the-art models and methods. They were the bidirectional encoder representations from transformer (BERT) with fine-tuning approach and ridge regression models utilizing advanced feature extraction. We conducted this study by doing stages of literature review, data set preparation, model development, implementation, and comparison. Using two different ASAG data sets, the best result of this study was an achievement of 0.9508 in pearson’s correlation and 0.4138 in root-mean-square error (RMSE) by the BERT-based model with the fine-tuning approach. This result outperformed the results of the previous studies using the same evaluation metrics. Thus, it proved our ASAG system using the BERT model with fine-tuning approach can improve the accuracy of grading short answers.</dc:description><dc:publisher>Institute of Advanced Engineering and Science (IAES)</dc:publisher><dc:date>2022-05-28</dc:date><dc:type>info:eu-repo/semantics/article</dc:type><dc:format>application/pdf</dc:format><dc:identifier>https://doi.org/10.11591/eei.v11i3.3531</dc:identifier><dc:identifier>10.11591/eei.v11i3.3531</dc:identifier><dc:source>Bulletin of Electrical Engineering and Informatics; Vol 11 No 3 (2022); 1586-1603</dc:source><dc:source>2089-3191</dc:source><dc:source>2302-9285</dc:source><dc:language>en</dc:language><dc:relation>https://beei.org/index.php/EEI/article/download/3531/2727</dc:relation><dc:rights>https://creativecommons.org/licenses/by-sa/4.0/</dc:rights></oai_dc:dc>