Melola Discovery

← Melola Discovery

Open access Journal SINTA 1

Academic engagement and artificial intelligence platform behaviors in grammar achievement

International Journal of Evaluation and Research in Education (IJERE) · Vol. 15 No. 3 (2026) · pp. 2690–2699

DOI
10.11591/ijere.v15i3.37822
ISSN
2620-5440, 2252-8822
Published
2026-06-01
Publisher
Institute of Advanced Engineering and Science
Language
eng
License
creativecommons.org/licenses/by-nc/4.0

Abstract

This study is among the first to use archival institutional records to test the incremental validity of artificial intelligence platform behaviors (AI_index) in predicting grammar achievement (GA). Using data from 405 non–English-major freshmen enrolled in a compulsory grammar course at a private Chinese university, we examined whether AI_index predicts end-of-semester grammar exam performance beyond course-embedded behavioral academic engagement (AE_index). AE_index was derived from grade-book quizzes and class interactions, whereas AI_index was constructed from institutional platform logs capturing coursework completion and assigned video viewing. Indices were scaled to a 0–100 range, and GA was measured by a unified final exam. Descriptive statistics, correlations, and hierarchical regression analyses showed that AE_index was a small but significant predictor of exam performance, whereas AI_index was weak and non-significant and added no incremental predictive value beyond AE_index. Together, the two indices explained a modest proportion of variance in GA. These findings suggest that completion-based platform metrics are unlikely to reflect effortful learning unless platform tasks align with summative assessment demands (e.g., translation and proofreading). The findings caution against using completion-based AI metrics as high-stakes indicators without demonstrated task–assessment alignment.

Keywords

Collaboration network of the authors

11 authors · 29 co-authorship links · 13 across different organisations

Hover or tap a name to highlight its co-authors. Double-click to open the author's page.

  • Universiti of Malaysia Sabah
  • National University of Malaysia
  • Guangzhou Xinhua University
  • Affiliation unknown
  • Different organisations
  • Same organisation
  • Affiliation unknown
  • Thicker line = more joint articles · bigger circle = more articles
Show as table
Co-authorOrganisationJoint articles
Balan RathakrishnanUniversiti of Malaysia Sabah2
Azizi YahayaUniversiti of Malaysia Sabah2
Mohammad Rahim KamaluddinNational University of Malaysia2
Melissa Edora SanuUniversiti of Malaysia Sabah1
Zaizul Ab RahmanNational University of Malaysia1
Fauziah binti IbrahimNational University of Malaysia1

Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.

Metadata source: OAI-PMH (metadata jurnal) http://ijere.iaescore.com/index.php/IJERE/oai, first harvested 8 Nov 2026, last seen 16 Nov 2026.
Original metadata (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Academic engagement and artificial intelligence platform behaviors in grammar achievement</dc:title>
	<dc:creator>Yadan, Wang</dc:creator>
	<dc:creator>Bikar Singh, Soon Singh</dc:creator>
	<dc:creator>Shin, Connie</dc:creator>
	<dc:creator>Juncai, Zheng</dc:creator>
	<dc:creator>Qianqian, Zhang</dc:creator>
	<dc:subject xml:lang="en-US">Academic engagement; Artificial intelligence; Grammar achievement; Higher education; Platform behaviors</dc:subject>
	<dc:description xml:lang="en-US">This study is among the first to use archival institutional records to test the incremental validity of artificial intelligence platform behaviors (AI_index) in predicting grammar achievement (GA). Using data from 405 non–English-major freshmen enrolled in a compulsory grammar course at a private Chinese university, we examined whether AI_index predicts end-of-semester grammar exam performance beyond course-embedded behavioral academic engagement (AE_index). AE_index was derived from grade-book quizzes and class interactions, whereas AI_index was constructed from institutional platform logs capturing coursework completion and assigned video viewing. Indices were scaled to a 0–100 range, and GA was measured by a unified final exam. Descriptive statistics, correlations, and hierarchical regression analyses showed that AE_index was a small but significant predictor of exam performance, whereas AI_index was weak and non-significant and added no incremental predictive value beyond AE_index. Together, the two indices explained a modest proportion of variance in GA. These findings suggest that completion-based platform metrics are unlikely to reflect effortful learning unless platform tasks align with summative assessment demands (e.g., translation and proofreading). The findings caution against using completion-based AI metrics as high-stakes indicators without demonstrated task–assessment alignment.</dc:description>
	<dc:publisher xml:lang="en-US">Institute of Advanced Engineering and Science</dc:publisher>
	<dc:contributor xml:lang="en-US">Soon Singh Bikar Singh, Universiti Malaysia Sabah</dc:contributor>
	<dc:contributor xml:lang="en-US">Guangzhou Xinhua University, School of Foreign Languages.</dc:contributor>
	<dc:date>2026-06-01</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US"></dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://ijere.iaescore.com/index.php/IJERE/article/view/37822</dc:identifier>
	<dc:identifier>10.11591/ijere.v15i3.37822</dc:identifier>
	<dc:source xml:lang="en-US">International Journal of Evaluation and Research in Education (IJERE); Vol 15, No 3: June 2026; 2690-2699</dc:source>
	<dc:source>2620-5440</dc:source>
	<dc:source>2252-8822</dc:source>
	<dc:source>10.11591/ijere.v15i3</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://ijere.iaescore.com/index.php/IJERE/article/view/37822/15115</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2026 Wang Yadan, Soon Singh Bikar Singh, Connie Shin, Zheng Juncai, Zhang Qianqian</dc:rights>
	<dc:rights xml:lang="en-US">http://creativecommons.org/licenses/by-nc/4.0</dc:rights>
</oai_dc:dc>