Open access Journal
Analysis of Differential Item Functioning on Students’ Mathematical Problem-Solving Ability Assessment Instruments
Edumatica : Jurnal Pendidikan Matematika · Vol. 15 No. 2 (2025) · pp. 176–197
- ISSN
- 2580-0779, 2088-2157
- Published
- 2025-07-25
- Publisher
- Department of Mathematics Education, Faculty of Teacher Training and Education, Universitas Jambi
- Language
- en
Abstract
The current problem-solving ability assessment tool lacks specified criteria for fair instrument items to measure students’ abilities across genders and grade levels. To ensure score validity, unfair or biased assessment items should be removed from the test instrument. This study analyzed the quality of assessment items for mathematical problem-solving abilities, considering variables of gender and class. This research is an instrument development study with a quantitative descriptive approach. Data collection using an online survey obtained responses from 362 high school students to 10 instrument items. The data analysis technique utilized classical test theory, employing an item functioning analysis approach through the Mantel-Haenszel method. The item validity analysis indicated that not all items were classified as biased among gender groups. Two items were identified as biased according to grade level groups. The reliability estimate was 0.829, indicating a high level of consistency in the results obtained using different samples. The study’s findings validate the bias item analysis approach and provide a reliable assessment tool for evaluating high school students’ mathematics problem-solving abilities. This study also suggests using modern theoretical analysis to identify item features that distinguish students’ ability, guessing levels, and carelessness in test item responses.
Keywords
Collaboration network of the authors
30 authors · 62 co-authorship links · 27 across different organisations
Hover or tap a name to highlight its co-authors. Double-click to open the author's page.
- Yogyakarta State University
- Sekolah Tinggi Ilmu Keguruan Dan Ilmu Pendidikan Yayasan Pendidikan Ujung Pandang
- Webster University
- National Research and Innovation Agency
- Universitas Gadjah Mada
- Sumatera Institute of Technology
- State University of Semarang
- Other organisations
- Affiliation unknown
- Different organisations
- Same organisation
- Affiliation unknown
- Thicker line = more joint articles · bigger circle = more articles
Show as table
| Co-author | Organisation | Joint articles |
|---|---|---|
| Heri Retnawati | Yogyakarta State University | 6 |
| Bayuk Nusantara | Yogyakarta State University | 2 |
| Jailani Jailani | Yogyakarta State University | 2 |
| Janu Arlinwibowo | National Research and Innovation Agency | 1 |
| Sumaryanto Sumaryanto | Yogyakarta State University | 1 |
| Lantip Diat Prasojo | Yogyakarta State University | 1 |
| Rimajon Sotlikova | Webster University | 1 |
| Dedi Rosadi | Universitas Gadjah Mada | 1 |
| Adhitya Ronnie Effendie | Sumatera Institute of Technology | 1 |
| Kasmila Ulansari | Sekolah Tinggi Ilmu Keguruan Dan Ilmu Pendidikan Yayasan Pendidikan Ujung Pandang | 1 |
| Edumatica Fkip | Affiliation unknown | 1 |
| Edi Istiyono | Yogyakarta State University | 1 |
| Untung Desy Purnamasari | Yogyakarta State University | 1 |
| Rizki Amelia | State University of Semarang | 1 |
| Sukirno Sukirno | Yogyakarta State University | 1 |
| Dian Normalitasari Purnama | Yogyakarta State University | 1 |
| Dedek Andrian | Islamic University of Riau | 1 |
| Siti Maisaroh | Universitas PGRI Yogyakarta | 1 |
| Veronika Asri Tandirerung | Yogyakarta State University | 1 |
| Syahrina Ramadina | Affiliation unknown | 1 |
| Vivianti Vivianti | Universitas Teknologi Yogyakarta | 1 |
| Kustitik Kustitik | STIKes Surya Global Yogyakarta | 1 |
| Ariyadi Chandra Nugraha | Yogyakarta State University | 1 |
| Tri Wulaningrum | Yogyakarta State University | 1 |
| Nurhening Yuniarti | Yogyakarta State University | 1 |
| Istanto Wahyu Djatmiko | Yogyakarta State University | 1 |
| Djoko Laras Budiyo Taruno | Yogyakarta State University | 1 |
Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.