Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Cross-Prompt Based Automatic Short Answer Grading System

CommIT (Communication and Information Technology) Journal · Vol. 19 No. 2 (2025) · hlm. 281–291

DOI
10.21512/commit.v19i2.13423
ISSN
2460-7010, 1979-2484
Terbit
2025-10-13
Penerbit
Bina Nusantara University
Bahasa
eng
Lisensi
creativecommons.org/licenses/by-sa/4.0

Abstrak

Research on Automatic Short Answer Grading (ASAG) has shown promising results in recent years. However, several important research gaps remain. Based on the literature review, the researchers identify two critical issues. First, the majority of ASAG models are trained and tested on responses to the same prompt which raises concerns about their robustness accross different prompts. Second, many existing approaches typically treat grading task as a binary classification problem. The research aims to bridge these gaps by developing an ASAG system that closely reflects real-world assessment scenarios through multiclass classification approach and cross-prompt evaluation. It is implemented by training the proposed models on 1,505 responses across 9 prompts and testing on 175 responses from 3 distinct prompts. The grading task is addressed using regression and classification techniques, including Linear Regression, Logistic Regression, Extreme Gradient Boosting (Xg-Boost), Adaptive Boosting (AdaBoost), and K-Nearest Neighbors (as a baseline). The grades are categorized into five classes that are represented by grade A to E. Both manual and algorithmic data augmentation techniques, including Syntactic Minority Oversampling Technique (SMOTE), are employed to address class imbalance in the sample data. Across multiple testing scenarios, all five models demonstrate consistent performance, with Linear Regression outperforming others. During the validation process, it achieves a high accuracy of 0.93, indicating its ability to correctly classify the responses. In the testing phase, it achieves a weighted F1-Score of 0.79, a macroaveraged F1-Score of 0.75, and an RMSE of 0.45. The results suggest relatively low prediction error.

Kata kunci

Jaringan kolaborasi para penulis

20 penulis · 44 tautan kepenulisan bersama · 13 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Multimedia University
  • Duta Wacana Christian University
  • Telkom University
  • SRM Institute of Science and Technology
  • Afiliasi tidak diketahui
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Kok-Why NgMultimedia University7
Palanichamy NaveenMultimedia University3
Naveen PalanichamyMultimedia University2
Sri SuwarnoDuta Wacana Christian University1
Samini SubramaniamAfiliasi tidak diketahui1
Poo Kuan HoongMultimedia University1
Gloria VirginiaDuta Wacana Christian University1
Bill Edward Butar-ButarDuta Wacana Christian University1
Lit-Jie ChewMultimedia University1
Dana Sulistyo KusumoTelkom University1
Mandy SiaMultimedia University1
J. JayapradhaSRM Institute of Science and Technology1
Elham Abdulwahab AnaamMultimedia University1
Gee-Kok TongMultimedia University1
Emyliana SongMultimedia University1
Shi-Kuo ChangMultimedia University1
Yih-Jian YoongMultimedia University1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) https://journal.binus.ac.id/index.php/commit/oai, pertama di-harvest 8 Nov 2026, terakhir terlihat 16 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Cross-Prompt Based Automatic Short Answer Grading System</dc:title>
	<dc:creator>Krisnawati, Lucia Dwi</dc:creator>
	<dc:creator>Mahastama, Aditya Wikan</dc:creator>
	<dc:creator>Haw, Su Cheng</dc:creator>
	<dc:subject xml:lang="en-US">Cross-Prompt</dc:subject>
	<dc:subject xml:lang="en-US">Automatic Short Answer Grading (ASAG)</dc:subject>
	<dc:subject xml:lang="en-US">Prompt-Specific</dc:subject>
	<dc:description xml:lang="en-US">Research on Automatic Short Answer Grading (ASAG) has shown promising results in recent years. However, several important research gaps remain. Based on the literature review, the researchers identify two critical issues. First, the majority of ASAG models are trained and tested on responses to the same prompt which raises concerns about their robustness accross different prompts. Second, many existing approaches typically treat grading task as a binary classification problem. The research aims to bridge these gaps by developing an ASAG system that closely reflects real-world assessment scenarios through multiclass classification approach and cross-prompt evaluation. It is implemented by training the proposed models on 1,505 responses across 9 prompts and testing on 175 responses from 3 distinct prompts. The grading task is addressed using regression and classification techniques, including Linear Regression, Logistic Regression, Extreme Gradient Boosting (Xg-Boost), Adaptive Boosting (AdaBoost), and K-Nearest Neighbors (as a baseline). The grades are categorized into five classes that are represented by grade A to E. Both manual and algorithmic data augmentation techniques, including Syntactic Minority Oversampling Technique (SMOTE), are employed to address class imbalance in the sample data. Across multiple testing scenarios, all five models demonstrate consistent performance, with Linear Regression outperforming others. During the validation process, it achieves a high accuracy of 0.93, indicating its ability to correctly classify the responses. In the testing phase, it achieves a weighted F1-Score of 0.79, a macroaveraged F1-Score of 0.75, and an RMSE of 0.45. The results suggest relatively low prediction error.</dc:description>
	<dc:publisher xml:lang="en-US">Bina Nusantara University</dc:publisher>
	<dc:date>2025-10-13</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.binus.ac.id/index.php/commit/article/view/13423</dc:identifier>
	<dc:identifier>10.21512/commit.v19i2.13423</dc:identifier>
	<dc:source xml:lang="en-US">CommIT (Communication and Information Technology) Journal; Vol. 19 No. 2 (2025): CommIT Journal ; 281-291</dc:source>
	<dc:source>2460-7010</dc:source>
	<dc:source>1979-2484</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.binus.ac.id/index.php/commit/article/view/13423/5542</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2025 Lucia Dwi Krisnawati, Aditya Wikan Mahastama, Su Cheng Haw</dc:rights>
	<dc:rights xml:lang="en-US">https://creativecommons.org/licenses/by-sa/4.0</dc:rights>
</oai_dc:dc>