Development and validation of a scale measuring students’ use of generative artificial intelligence tools

Barcelona, Alvin; Dela Cruz, Sam Rhoy

doi:10.11591/ijere.v14i5.34809

Akses terbuka Jurnal SINTA 1

Development and validation of a scale measuring students’ use of generative artificial intelligence tools

International Journal of Evaluation and Research in Education (IJERE) · Vol. 14 No. 5 (2025) · hlm. 3612–3621

DOI: 10.11591/ijere.v14i5.34809
ISSN: 2620-5440, 2252-8822
Terbit: 2025-10-01
Penerbit: Institute of Advanced Engineering and Science
Bahasa: eng
Lisensi: creativecommons.org/licenses/by-nc/4.0

Abstrak

The emergence of artificial intelligence (AI) in education, such as students’ use of generative artificial intelligence (GAI) tools in academic work, has profoundly transformed the learning ecosystem, offering both promising opportunities and potential challenges. Considering that such tools are still a developing area of study in education, this paper aimed to develop a scale that can assess and describe students’ practices and perspectives towards using GAI tools. Through an exploratory-sequential mixed methods design, an interview of 20 higher education students and a scoping literature review were used to generate scale items in the first phase of the study. In the second phase of the study, two pilot tests of the scale participated by 793 students were implemented. Exploratory and confirmatory factor analysis (CFA), internal consistency, and convergent validity tests were also carried out. The developed scale consists of 26 statements covering the following factors: i) research tool; ii) communication tool; iii) reliance; and iv) ethical use. The CFA model confirmed these factors, and all fit indices show that the overall structure of the scale has acceptable to good fit. The scale’s psychometric properties reveal that it is valid and reliable. This scale development study implicates schools to use a structured way of assessing how students engage with GAI tools in academic settings and rethink ways to support students’ learning through the responsible use of AI tools.

Kata kunci

Jaringan kolaborasi para penulis

9 penulis · 24 tautan kepenulisan bersama · 2 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

Philippine Normal University
Dr. Yanga's Colleges, Inc.
Afiliasi tidak diketahui

Organisasi berbeda
Organisasi sama
Afiliasi tidak diketahui
Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel

Tampilkan sebagai tabel

Rekan penulis	Organisasi	Artikel bersama
Joliber M. Caminong	Dr. Yanga's Colleges, Inc.	2
Marla C. Papango	Afiliasi tidak diketahui	1
Marilyn U. Balagtas	Philippine Normal University	1
Adonis P. David	Philippine Normal University	1
Erminda C. Fortes	Philippine Normal University	1
Arceli M. Amarles	Philippine Normal University	1
Marjorie P. Naquita	Philippine Normal University	1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) http://ijere.iaescore.com/index.php/IJERE/oai, pertama di-harvest 8 Nov 2026, terakhir terlihat 8 Nov 2026.

Metadata asli (oai_dc)

<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Development and validation of a scale measuring students’ use of generative artificial intelligence tools</dc:title>
	<dc:creator>Barcelona, Alvin</dc:creator>
	<dc:creator>Dela Cruz, Sam Rhoy</dc:creator>
	<dc:subject xml:lang="en-US">Artificial intelligence; Confirmatory factor analysis; Exploratory factor analysis; Generative artificial intelligence; Scale development</dc:subject>
	<dc:description xml:lang="en-US">The emergence of artificial intelligence (AI) in education, such as students’ use of generative artificial intelligence (GAI) tools in academic work, has profoundly transformed the learning ecosystem, offering both promising opportunities and potential challenges. Considering that such tools are still a developing area of study in education, this paper aimed to develop a scale that can assess and describe students’ practices and perspectives towards using GAI tools. Through an exploratory-sequential mixed methods design, an interview of 20 higher education students and a scoping literature review were used to generate scale items in the first phase of the study. In the second phase of the study, two pilot tests of the scale participated by 793 students were implemented. Exploratory and confirmatory factor analysis (CFA), internal consistency, and convergent validity tests were also carried out. The developed scale consists of 26 statements covering the following factors: i) research tool; ii) communication tool; iii) reliance; and iv) ethical use. The CFA model confirmed these factors, and all fit indices show that the overall structure of the scale has acceptable to good fit. The scale’s psychometric properties reveal that it is valid and reliable. This scale development study implicates schools to use a structured way of assessing how students engage with GAI tools in academic settings and rethink ways to support students’ learning through the responsible use of AI tools.</dc:description>
	<dc:publisher xml:lang="en-US">Institute of Advanced Engineering and Science</dc:publisher>
	<dc:contributor xml:lang="en-US">none</dc:contributor>
	<dc:date>2025-10-01</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US"></dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://ijere.iaescore.com/index.php/IJERE/article/view/34809</dc:identifier>
	<dc:identifier>10.11591/ijere.v14i5.34809</dc:identifier>
	<dc:source xml:lang="en-US">International Journal of Evaluation and Research in Education (IJERE); Vol 14, No 5: October 2025; 3612-3621</dc:source>
	<dc:source>2620-5440</dc:source>
	<dc:source>2252-8822</dc:source>
	<dc:source>10.11591/ijere.v14i5</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://ijere.iaescore.com/index.php/IJERE/article/view/34809/14674</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2025 Alvin Barcelona, Sam Rhoy Dela Cruz</dc:rights>
	<dc:rights xml:lang="en-US">http://creativecommons.org/licenses/by-nc/4.0</dc:rights>
</oai_dc:dc>