Open access
Journal
SINTA 1
Academic engagement and artificial intelligence platform behaviors in grammar achievement
International Journal of Evaluation and Research in Education (IJERE) · Vol. 15 No. 3 (2026) · pp. 2690–2699
ISSN 2620-5440, 2252-8822
Published 2026-06-01
Publisher Institute of Advanced Engineering and Science
Language eng
Abstract
This study is among the first to use archival institutional records to test the incremental validity of artificial intelligence platform behaviors (AI_index) in predicting grammar achievement (GA). Using data from 405 non–English-major freshmen enrolled in a compulsory grammar course at a private Chinese university, we examined whether AI_index predicts end-of-semester grammar exam performance beyond course-embedded behavioral academic engagement (AE_index). AE_index was derived from grade-book quizzes and class interactions, whereas AI_index was constructed from institutional platform logs capturing coursework completion and assigned video viewing. Indices were scaled to a 0–100 range, and GA was measured by a unified final exam. Descriptive statistics, correlations, and hierarchical regression analyses showed that AE_index was a small but significant predictor of exam performance, whereas AI_index was weak and non-significant and added no incremental predictive value beyond AE_index. Together, the two indices explained a modest proportion of variance in GA. These findings suggest that completion-based platform metrics are unlikely to reflect effortful learning unless platform tasks align with summative assessment demands (e.g., translation and proofreading). The findings caution against using completion-based AI metrics as high-stakes indicators without demonstrated task–assessment alignment.
Collaboration network of the authors
11 authors ·
29 co-authorship links
· 13 across different organisations
Hover or tap a name to highlight its co-authors. Double-click to open the author's page.
Universiti of Malaysia Sabah National University of Malaysia Guangzhou Xinhua University Affiliation unknown
Different organisations
Same organisation
Affiliation unknown
Thicker line = more joint articles · bigger circle = more articles
Show as table
Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.
Metadata source: OAI-PMH (metadata jurnal) http://ijere.iaescore.com/index.php/IJERE/oai, first harvested 8 Nov 2026, last seen 16 Nov 2026.
Original metadata (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
<dc:title xml:lang="en-US">Academic engagement and artificial intelligence platform behaviors in grammar achievement</dc:title>
<dc:creator>Yadan, Wang</dc:creator>
<dc:creator>Bikar Singh, Soon Singh</dc:creator>
<dc:creator>Shin, Connie</dc:creator>
<dc:creator>Juncai, Zheng</dc:creator>
<dc:creator>Qianqian, Zhang</dc:creator>
<dc:subject xml:lang="en-US">Academic engagement; Artificial intelligence; Grammar achievement; Higher education; Platform behaviors</dc:subject>
<dc:description xml:lang="en-US">This study is among the first to use archival institutional records to test the incremental validity of artificial intelligence platform behaviors (AI_index) in predicting grammar achievement (GA). Using data from 405 non–English-major freshmen enrolled in a compulsory grammar course at a private Chinese university, we examined whether AI_index predicts end-of-semester grammar exam performance beyond course-embedded behavioral academic engagement (AE_index). AE_index was derived from grade-book quizzes and class interactions, whereas AI_index was constructed from institutional platform logs capturing coursework completion and assigned video viewing. Indices were scaled to a 0–100 range, and GA was measured by a unified final exam. Descriptive statistics, correlations, and hierarchical regression analyses showed that AE_index was a small but significant predictor of exam performance, whereas AI_index was weak and non-significant and added no incremental predictive value beyond AE_index. Together, the two indices explained a modest proportion of variance in GA. These findings suggest that completion-based platform metrics are unlikely to reflect effortful learning unless platform tasks align with summative assessment demands (e.g., translation and proofreading). The findings caution against using completion-based AI metrics as high-stakes indicators without demonstrated task–assessment alignment.</dc:description>
<dc:publisher xml:lang="en-US">Institute of Advanced Engineering and Science</dc:publisher>
<dc:contributor xml:lang="en-US">Soon Singh Bikar Singh, Universiti Malaysia Sabah</dc:contributor>
<dc:contributor xml:lang="en-US">Guangzhou Xinhua University, School of Foreign Languages.</dc:contributor>
<dc:date>2026-06-01</dc:date>
<dc:type>info:eu-repo/semantics/article</dc:type>
<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
<dc:type xml:lang="en-US"></dc:type>
<dc:format>application/pdf</dc:format>
<dc:identifier>https://ijere.iaescore.com/index.php/IJERE/article/view/37822</dc:identifier>
<dc:identifier>10.11591/ijere.v15i3.37822</dc:identifier>
<dc:source xml:lang="en-US">International Journal of Evaluation and Research in Education (IJERE); Vol 15, No 3: June 2026; 2690-2699</dc:source>
<dc:source>2620-5440</dc:source>
<dc:source>2252-8822</dc:source>
<dc:source>10.11591/ijere.v15i3</dc:source>
<dc:language>eng</dc:language>
<dc:relation>https://ijere.iaescore.com/index.php/IJERE/article/view/37822/15115</dc:relation>
<dc:rights xml:lang="en-US">Copyright (c) 2026 Wang Yadan, Soon Singh Bikar Singh, Connie Shin, Zheng Juncai, Zhang Qianqian</dc:rights>
<dc:rights xml:lang="en-US">http://creativecommons.org/licenses/by-nc/4.0</dc:rights>
</oai_dc:dc>
Citations and indexing
OpenAlex
Indexed
via DOI
1 citation
Crossref
Indexed
via DOI
0 citations
Counts as reported by each index on 13 Nov 2026; indexes count citations differently.
OpenAlex also lists this work in: crossref.
Cite this article
APA 7
Yadan, W., Bikar Singh, S. S., Shin, C., Juncai, Z., & Qianqian, Z. (2026). Academic engagement and artificial intelligence platform behaviors in grammar achievement. International Journal of Evaluation and Research in Education (IJERE), 15(3), 2690–2699. https://doi.org/10.11591/ijere.v15i3.37822
Copy
IEEE
W. Yadan, S. S. Bikar Singh, C. Shin, Z. Juncai, and Z. Qianqian, “Academic engagement and artificial intelligence platform behaviors in grammar achievement,” International Journal of Evaluation and Research in Education (IJERE), vol. 15, no. 3, pp. 2690–2699, 2026, doi: 10.11591/ijere.v15i3.37822.
Copy
Generated from the journal's metadata; check author names before use.