Melola Discovery

← Melola Discovery

Open access Journal

Analysis of Differential Item Functioning on Students’ Mathematical Problem-Solving Ability Assessment Instruments

Edumatica : Jurnal Pendidikan Matematika · Vol. 15 No. 2 (2025) · pp. 176–197

DOI
10.22437/edumatica.v15i2.44361
ISSN
2580-0779, 2088-2157
Published
2025-07-25
Publisher
Department of Mathematics Education, Faculty of Teacher Training and Education, Universitas Jambi
Language
en
License
creativecommons.org/licenses/by-nc-sa/4.0

Abstract

The current problem-solving ability assessment tool lacks specified criteria for fair instrument items to measure students’ abilities across genders and grade levels. To ensure score validity, unfair or biased assessment items should be removed from the test instrument. This study analyzed the quality of assessment items for mathematical problem-solving abilities, considering variables of gender and class. This research is an instrument development study with a quantitative descriptive approach. Data collection using an online survey obtained responses from 362 high school students to 10 instrument items. The data analysis technique utilized classical test theory, employing an item functioning analysis approach through the Mantel-Haenszel method. The item validity analysis indicated that not all items were classified as biased among gender groups. Two items were identified as biased according to grade level groups. The reliability estimate was 0.829, indicating a high level of consistency in the results obtained using different samples. The study’s findings validate the bias item analysis approach and provide a reliable assessment tool for evaluating high school students’ mathematics problem-solving abilities. This study also suggests using modern theoretical analysis to identify item features that distinguish students’ ability, guessing levels, and carelessness in test item responses.

Keywords

Collaboration network of the authors

30 authors · 62 co-authorship links · 27 across different organisations

Hover or tap a name to highlight its co-authors. Double-click to open the author's page.

  • Yogyakarta State University
  • Sekolah Tinggi Ilmu Keguruan Dan Ilmu Pendidikan Yayasan Pendidikan Ujung Pandang
  • Webster University
  • National Research and Innovation Agency
  • Universitas Gadjah Mada
  • Sumatera Institute of Technology
  • State University of Semarang
  • Other organisations
  • Affiliation unknown
  • Different organisations
  • Same organisation
  • Affiliation unknown
  • Thicker line = more joint articles · bigger circle = more articles
Show as table
Co-authorOrganisationJoint articles
Heri RetnawatiYogyakarta State University6
Bayuk NusantaraYogyakarta State University2
Jailani JailaniYogyakarta State University2
Janu ArlinwibowoNational Research and Innovation Agency1
Sumaryanto SumaryantoYogyakarta State University1
Lantip Diat PrasojoYogyakarta State University1
Rimajon SotlikovaWebster University1
Dedi RosadiUniversitas Gadjah Mada1
Adhitya Ronnie EffendieSumatera Institute of Technology1
Kasmila UlansariSekolah Tinggi Ilmu Keguruan Dan Ilmu Pendidikan Yayasan Pendidikan Ujung Pandang1
Edumatica FkipAffiliation unknown1
Edi IstiyonoYogyakarta State University1
Untung Desy PurnamasariYogyakarta State University1
Rizki AmeliaState University of Semarang1
Sukirno SukirnoYogyakarta State University1
Dian Normalitasari PurnamaYogyakarta State University1
Dedek AndrianIslamic University of Riau1
Siti MaisarohUniversitas PGRI Yogyakarta1
Veronika Asri TandirerungYogyakarta State University1
Syahrina RamadinaAffiliation unknown1
Vivianti ViviantiUniversitas Teknologi Yogyakarta1
Kustitik KustitikSTIKes Surya Global Yogyakarta1
Ariyadi Chandra NugrahaYogyakarta State University1
Tri WulaningrumYogyakarta State University1
Nurhening YuniartiYogyakarta State University1
Istanto Wahyu DjatmikoYogyakarta State University1
Djoko Laras Budiyo TarunoYogyakarta State University1

Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.

Metadata source: OAI-PMH (metadata jurnal) https://online-journal.unja.ac.id/index.php/edumatica/oai, first harvested 6 Nov 2026, last seen 16 Nov 2026.
Original metadata (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en">Analysis of Differential Item Functioning on Students’ Mathematical Problem-Solving Ability Assessment Instruments</dc:title>
	<dc:creator xml:lang="en">Ridwan, M. Rais</dc:creator>
	<dc:creator xml:lang="en">Hadi, Samsul</dc:creator>
	<dc:creator xml:lang="en">Zuhairoh, Faihatuz</dc:creator>
	<dc:subject xml:lang="en">bias assessment</dc:subject>
	<dc:subject xml:lang="en">differential item functioning</dc:subject>
	<dc:subject xml:lang="en">Mantel-Haenszel method</dc:subject>
	<dc:subject xml:lang="en">problem-solving ability</dc:subject>
	<dc:subject xml:lang="en">validity and reliability estimation</dc:subject>
	<dc:subject xml:lang="id">kemampuan pemecahan masalah</dc:subject>
	<dc:subject xml:lang="id">metode Mantel-Haenszel</dc:subject>
	<dc:subject xml:lang="id">penilaian bias</dc:subject>
	<dc:subject xml:lang="id">perbedaan keberfungsian butir</dc:subject>
	<dc:subject xml:lang="id">validitas dan estimasi reliabilitas</dc:subject>
	<dc:description xml:lang="en">The current problem-solving ability assessment tool lacks specified criteria for fair instrument items to measure students’ abilities across genders and grade levels. To ensure score validity, unfair or biased assessment items should be removed from the test instrument. This study analyzed the quality of assessment items for mathematical problem-solving abilities, considering variables of gender and class. This research is an instrument development study with a quantitative descriptive approach. Data collection using an online survey obtained responses from 362 high school students to 10 instrument items. The data analysis technique utilized classical test theory, employing an item functioning analysis approach through the Mantel-Haenszel method. The item validity analysis indicated that not all items were classified as biased among gender groups. Two items were identified as biased according to grade level groups. The reliability estimate was 0.829, indicating a high level of consistency in the results obtained using different samples. The study’s findings validate the bias item analysis approach and provide a reliable assessment tool for evaluating high school students’ mathematics problem-solving abilities. This study also suggests using modern theoretical analysis to identify item features that distinguish students’ ability, guessing levels, and carelessness in test item responses.</dc:description>
	<dc:publisher xml:lang="en">Department of Mathematics Education, Faculty of Teacher Training and Education, Universitas Jambi</dc:publisher>
	<dc:date>2025-07-25</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://online-journal.unja.ac.id/edumatica/article/view/44361</dc:identifier>
	<dc:identifier>10.22437/edumatica.v15i2.44361</dc:identifier>
	<dc:source xml:lang="en">Edumatica : Jurnal Pendidikan Matematika; Vol. 15 No. 2 (2025): Edumatica: Jurnal Pendidikan matematika (August 2025); 176-197</dc:source>
	<dc:source xml:lang="id">Edumatica : Jurnal Pendidikan Matematika; Vol 15 No 2 (2025): Edumatica: Jurnal Pendidikan matematika (Agustus 2025); 176-197</dc:source>
	<dc:source>2580-0779</dc:source>
	<dc:source>2088-2157</dc:source>
	<dc:language>en</dc:language>
	<dc:relation>https://online-journal.unja.ac.id/edumatica/article/view/44361/21723</dc:relation>
	<dc:rights xml:lang="en">Copyright (c) 2025 M. Rais Ridwan, Samsul Hadi, Faihatuz Zuhairoh</dc:rights>
	<dc:rights xml:lang="en">http://creativecommons.org/licenses/by-nc-sa/4.0</dc:rights>
</oai_dc:dc>