Melola Discovery

← Melola Discovery

Jurnal SINTA 1

Evaluating Computerized Adaptive Testing Efficiency in Measuring Students’ Performance in Science TIMSS

Jurnal Pendidikan IPA Indonesia · Vol. 8 No. 4 (2019) · pp. 547–560

DOI
10.15294/jpii.v8i4.19417
ISSN
2089-4392, 2339-1286
Published
2019-12-31
Publisher
Program Studi Pendidikan IPA Fakultas Matematika dan Ilmu Pengetahuan Alam (FMIPA)
Language
eng

Abstract

The current standards of assessment are demanding for high level of precision with less time-consuming and personalized opportunities, thus restrict the function of Paper and Pencil Test which has dominated the assessment field for a very long time. The Computerized Adaptive Testing (CAT) is viewed as an alternative testing tool to Paper and Pencil Test as it has adaptive feature which enables it to meet the current standards of assessment. This research is focusing on the evaluation of students’ ability in Grade 8 Science Trend in International Mathematics and Science Study (TIMSS) using Computerized Adaptive Testing (CAT) as an alternative instrument to Paper and Pencil Test to investigate whether the implementation of CAT can produce high level of precision with fewer items administered as well as differentiate different academic level among groups of students. CAT was configured in Concerto and was administered on Form 2 and Form 4 students selected through purposive sampling method from secondary schools in northern part of Malaysia. Students’ performance was analysed and compared in terms of score (theta value), SEM value and their response toward the items selected in CAT using SPSS. Finding shows that the administration of 20 objective items in fixed length CAT produced SEM ≤0.50 indicated that the implemented CAT increased the efficiency of assessment with fewer item administration. The t test showed that there was a significance difference between the two groups’ scores in CAT in which Form 4 students had higher ability level than Form 2 students proving that CAT’s configuration had been done correctly in Concerto and the test was more suitable in challenging Form 2 students’ Science knowledge thus the instrument fulfilled the known-group validity.

Keywords

Collaboration network of the authors

7 authors · 13 co-authorship links · 9 across different organisations

Hover or tap a name to highlight its co-authors. Double-click to open the author's page.

  • Universiti Sains Malaysia
  • Tun Hussein Onn University of Malaysia
  • Siliwangi University
  • Universiti Brunei Darussalam
  • Different organisations
  • Same organisation
  • Affiliation unknown
  • Thicker line = more joint articles · bigger circle = more articles
Show as table
Co-authorOrganisationJoint articles
Nur Jahan AhmadUniversiti Sains Malaysia1
Nor Asniza IshakUniversiti Sains Malaysia1
Vita MeylaniSiliwangi University1
Hardimah Mohd. SaidUniversiti Brunei Darussalam1

Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.

Metadata source: OAI-PMH (metadata jurnal) https://journal.unnes.ac.id/nju/index.php/jpii/oai, first harvested 29 Okt 2026, last seen 1 Nov 2026.
Original metadata (oai_dc) 
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Evaluating Computerized Adaptive Testing Efficiency in Measuring Students’ Performance in Science TIMSS</dc:title>
	<dc:creator>Samsudin, M. A.</dc:creator>
	<dc:creator>Som Chut, T.</dc:creator>
	<dc:creator>Ismail, M. E.</dc:creator>
	<dc:subject xml:lang="en-US">ability, Computerized Adaptive Testing (CAT), evaluation, TIMSS</dc:subject>
	<dc:description xml:lang="en-US">The current standards of assessment are demanding for high level of precision with less time-consuming and personalized opportunities, thus restrict the function of Paper and Pencil Test which has dominated the assessment field for a very long time. The Computerized Adaptive Testing (CAT) is viewed as an alternative testing tool to Paper and Pencil Test as it has adaptive feature which enables it to meet the current standards of assessment. This research is focusing on the evaluation of students’ ability in Grade 8 Science Trend in International Mathematics and Science Study (TIMSS) using Computerized Adaptive Testing (CAT) as an alternative instrument to Paper and Pencil Test to investigate whether the implementation of CAT can produce high level of precision with fewer items administered as well as differentiate different academic level among groups of students. CAT was configured in Concerto and was administered on Form 2 and Form 4 students selected through purposive sampling method from secondary schools in northern part of Malaysia. Students’ performance was analysed and compared in terms of score (theta value), SEM value and their response toward the items selected in CAT using SPSS. Finding shows that the administration of 20 objective items in fixed length CAT produced SEM ≤0.50 indicated that the implemented CAT increased the efficiency of assessment with fewer item administration. The t test showed that there was a significance difference between the two groups’ scores in CAT in which Form 4 students had higher ability level than Form 2 students proving that CAT’s configuration had been done correctly in Concerto and the test was more suitable in challenging Form 2 students’ Science knowledge thus the instrument fulfilled the known-group validity.</dc:description>
	<dc:publisher xml:lang="en-US">Program Studi Pendidikan IPA Fakultas Matematika dan Ilmu Pengetahuan Alam (FMIPA)</dc:publisher>
	<dc:contributor xml:lang="en-US"></dc:contributor>
	<dc:date>2019-12-31</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.unnes.ac.id/nju/jpii/article/view/19417</dc:identifier>
	<dc:identifier>10.15294/jpii.v8i4.19417</dc:identifier>
	<dc:source xml:lang="en-US">Jurnal Pendidikan IPA Indonesia; Vol 8, No 4 (2019): December 2019; 547-560</dc:source>
	<dc:source>2089-4392</dc:source>
	<dc:source>2339-1286</dc:source>
	<dc:source>10.15294/jpii.v8i4</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.unnes.ac.id/nju/jpii/article/view/19417/9971</dc:relation>
	<dc:relation>https://journal.unnes.ac.id/nju/jpii/article/downloadSuppFile/19417/5084</dc:relation>
	<dc:relation>https://journal.unnes.ac.id/nju/jpii/article/downloadSuppFile/19417/5085</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2019 Jurnal Pendidikan IPA Indonesia</dc:rights>
</oai_dc:dc>