Melola Discovery

← Melola Discovery

Jurnal Tanpa peringkat SINTA

Automated Essay-Answer Grading using Transformer and GenAI-Based Error Analysis on Answer Sentence

Scientific Journal of Informatics · Vol. 13 No. 1 (2026) · hlm. 157–166

DOI
10.15294/sji.v13i1.39859
ISSN
2407-7658, 2460-0040
Terbit
2026-03-27
Penerbit
Universitas Negeri Semarang
Bahasa
eng

Abstrak

Purpose: This study aims to address the limitations of manual essay assessment, which is time-consuming and prone to subjectivity, by developing an automated essay grading system that is faster, more efficient, and more objective. In addition to producing scores, the system is intended to support learning by providing meaningful feedback on students’ writing errors. Methods: The research applies a transformer-based approach to automated essay scoring in order to capture deeper semantic relationships between student answers and reference answers. Unlike conventional word embedding methods, transformers are used to model contextual meaning at the word, phrase, and sentence levels. The system is further enhanced with an AI-based error analysis module that identifies categories of student errors, including content omissions, conceptual misunderstandings, and structural inaccuracies, enabling the generation of corrective feedback alongside numerical scores. Result: The experimental results show that the proposed model achieves strong agreement with human scoring, indicated by a Pearson correlation coefficient (r) of 0.8432 and a Mean Absolute Error (MAE) of 0.6013. These results demonstrate an improvement in prediction accuracy compared to word embedding-based approaches. Furthermore, the system successfully generates relevant and actionable error feedback that supports students in understanding their mistakes and improving their essay quality. Novelty: The novelty of this research lies in the integration of transformer-based automated essay scoring with an AI-driven error analysis module. Rather than focusing solely on score prediction accuracy, the proposed approach combines quantitative scoring with qualitative error feedback, enabling the system to function not only as an assessment tool but also as a learning support mechanism that helps students understand and improve their writing.

Kata kunci

Jaringan kolaborasi para penulis

6 penulis · 7 tautan kepenulisan bersama

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Bandung Institute of Technology
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Suhono Harso SupangkatBandung Institute of Technology1
Fetty Fitriyanti LubisBandung Institute of Technology1
Suhardi SuhardiBandung Institute of Technology1
Budi Laksono PutroBandung Institute of Technology1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) https://journal.unnes.ac.id/journals/sji/oai, pertama di-harvest 6 Nov 2026, terakhir terlihat 8 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en">Automated Essay-Answer Grading using Transformer and GenAI-Based Error Analysis on Answer Sentence</dc:title>
	<dc:creator xml:lang="en">Qusyairi, Mohammad Mirza </dc:creator>
	<dc:creator xml:lang="en">Yusep Rosmansyah</dc:creator>
	<dc:subject xml:lang="en">Automatic essay grading</dc:subject>
	<dc:subject xml:lang="en">Transformer</dc:subject>
	<dc:subject xml:lang="en">Error analysis</dc:subject>
	<dc:subject xml:lang="en">Accuracy improvement</dc:subject>
	<dc:description xml:lang="en">Purpose: This study aims to address the limitations of manual essay assessment, which is time-consuming and prone to subjectivity, by developing an automated essay grading system that is faster, more efficient, and more objective. In addition to producing scores, the system is intended to support learning by providing meaningful feedback on students’ writing errors.
Methods: The research applies a transformer-based approach to automated essay scoring in order to capture deeper semantic relationships between student answers and reference answers. Unlike conventional word embedding methods, transformers are used to model contextual meaning at the word, phrase, and sentence levels. The system is further enhanced with an AI-based error analysis module that identifies categories of student errors, including content omissions, conceptual misunderstandings, and structural inaccuracies, enabling the generation of corrective feedback alongside numerical scores.
Result: The experimental results show that the proposed model achieves strong agreement with human scoring, indicated by a Pearson correlation coefficient (r) of 0.8432 and a Mean Absolute Error (MAE) of 0.6013. These results demonstrate an improvement in prediction accuracy compared to word embedding-based approaches. Furthermore, the system successfully generates relevant and actionable error feedback that supports students in understanding their mistakes and improving their essay quality.
Novelty: The novelty of this research lies in the integration of transformer-based automated essay scoring with an AI-driven error analysis module. Rather than focusing solely on score prediction accuracy, the proposed approach combines quantitative scoring with qualitative error feedback, enabling the system to function not only as an assessment tool but also as a learning support mechanism that helps students understand and improve their writing.</dc:description>
	<dc:publisher xml:lang="en">Universitas Negeri Semarang</dc:publisher>
	<dc:date>2026-03-27</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.unnes.ac.id/journals/sji/article/view/39859</dc:identifier>
	<dc:identifier>10.15294/sji.v13i1.39859</dc:identifier>
	<dc:source xml:lang="en">Scientific Journal of Informatics; Vol. 13 No. 1: Regular Issue; 157-166</dc:source>
	<dc:source>2407-7658</dc:source>
	<dc:source>2460-0040</dc:source>
	<dc:source>10.15294/sji.v13i1</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.unnes.ac.id/journals/sji/article/view/39859/8861</dc:relation>
	<dc:rights xml:lang="en">Copyright (c) 2026 Scientific Journal of Informatics</dc:rights>
</oai_dc:dc>