Melola Discovery

← Melola Discovery

Journal

Development of Minimum Competency Evaluation Instrument to Analyze Conceptual and Daily Life Abilities Based on The Rasch Model

Journal of Research and Educational Research Evaluation · Vol. 13 No. 1 (2024) · pp. 73–84

ISSN
2503-1732, 2252-6420
Published
2024-03-30
Publisher
Universitas Negeri Semarang
Language
eng

Abstract

Evaluating educational outcomes is crucial to ensuring that students develop both conceptual understanding and practical skills. However, existing evaluation methods often fail to comprehensively address both aspects. This study aims to fill this gap by developing a prototype evaluation instrument utilizing the Rasch Model to assess students' minimum competencies in conceptual understanding and real-life application. This research is developmental in nature. It includes content validity, reliability, and construct validity of the developed instrument. The study's respondents consist of 5 experts in the expert testing phase, 28 individuals in the small-scale test, and 132 individuals in the large-scale test. Data collection was conducted using both quantitative and qualitative approaches. The developed evaluation instrument provides a comprehensive assessment of minimum competencies in conceptual understanding and real-life application. The reliability tests include inter-rater reliability at 0.769, Cronbach's Alpha reliability for the small-scale test at 0.86 for single- point questions and 0.83 for four-point questions. The large-scale test results show a Cronbach's Alpha reliability of 0.87 for single-point questions and 0.83 for four-point questions. Based on the research findings and discussion, it can be concluded that the developed evaluation instrument for minimum competencies in conceptual understanding and real-life application demonstrates good validity and reliability. This study has the potential to significantly contribute to a more holistic evaluation of education.

Keywords

Collaboration network of the authors

40 authors · 229 co-authorship links · 4 across different organisations · showing the 40 most connected

Hover or tap a name to highlight its co-authors. Double-click to open the author's page.

  • State University of Semarang
  • Universitas Airlangga
  • Walisongo State Islamic University
  • Affiliation unknown
  • Different organisations
  • Same organisation
  • Affiliation unknown
  • Thicker line = more joint articles · bigger circle = more articles
Show as table
Co-authorOrganisationJoint articles
Sri HaryaniAffiliation unknown12
Kartono KartonoUniversitas Airlangga9
Sigit PriatmokoState University of Semarang8
Sri WardaniState University of Semarang6
Kasmui KasmuiState University of Semarang6
Nanik WijayatiState University of Semarang6
Ani RusilowatiState University of Semarang6
Sri NurhayatiState University of Semarang5
Sri Susilogati SumartiState University of Semarang5
Murbangun NuswowatiState University of Semarang4
Eko Budi SusatyoAffiliation unknown4
Harjito HarjitoAffiliation unknown4
Supartono SupartonoAffiliation unknown4
Jumaeri JumaeriAffiliation unknown4
Kasmadi Imam SupardiState University of Semarang4
Agung Tri PrasetyaState University of Semarang4
Woro SumarniState University of Semarang3
Edy CahyonoState University of Semarang3
Triastuti SulistyaningsihAffiliation unknown3
Ian YuliantiAffiliation unknown3
Wiwi IsnaeniState University of Semarang3
Roudloh Muna LiaAffiliation unknown3
Suraji SurajiAffiliation unknown3
Hardi SuyitnoAffiliation unknown3
Bambang SubaliAffiliation unknown3
Apriliana DrastisiantiWalisongo State Islamic University2
Mochamad Nur SholikhinAffiliation unknown2
Yosephine Debbie DamayantiAffiliation unknown2
Sudarmin SudarminAffiliation unknown2
Harjono HarjonoAffiliation unknown2
Cepi KurniawanState University of Semarang2
Achmad BinadjaAffiliation unknown2
Azza Khisnu AddianiAffiliation unknown2
Sri Susilogati SumartiAffiliation unknown2
Sarwi SarwiAffiliation unknown2
Muhammad KhumaediAffiliation unknown2
Agus WahyudinAffiliation unknown2

Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.

Metadata source: OAI-PMH (metadata jurnal) https://journal.unnes.ac.id/journals/jere/oai, first harvested 6 Nov 2026, last seen 6 Nov 2026.
Original metadata (oai_dc) 
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en">Development of Minimum Competency Evaluation Instrument to Analyze Conceptual and Daily Life Abilities Based on The Rasch Model</dc:title>
	<dc:creator xml:lang="en">Lutfi Amin, Muhammad</dc:creator>
	<dc:creator xml:lang="en">Supriyadi, Supriyadi</dc:creator>
	<dc:creator xml:lang="en">Susilaningsih, Endang</dc:creator>
	<dc:subject xml:lang="en">Minimum Competency Evaluation</dc:subject>
	<dc:subject xml:lang="en">Conceptual Abilities</dc:subject>
	<dc:subject xml:lang="en">Daily Life</dc:subject>
	<dc:subject xml:lang="en">Rasch Model</dc:subject>
	<dc:description xml:lang="en">Evaluating educational outcomes is crucial to ensuring that students develop both conceptual understanding and practical skills. However, existing evaluation methods often fail to comprehensively address both aspects. This study aims to fill this gap by developing a prototype evaluation instrument utilizing the Rasch Model to assess students' minimum competencies in conceptual understanding and real-life application. This research is developmental in nature. It includes content validity, reliability, and construct validity of the developed instrument. The study's respondents consist of 5 experts in the expert testing phase, 28 individuals in the small-scale test, and 132 individuals in the large-scale test. Data collection was conducted using both quantitative and qualitative approaches. The developed evaluation instrument provides a comprehensive assessment of minimum competencies in conceptual understanding and real-life application. The reliability tests include inter-rater reliability at 0.769, Cronbach's Alpha reliability for the small-scale test at 0.86 for single- point questions and 0.83 for four-point questions. The large-scale test results show a Cronbach's Alpha reliability of 0.87 for single-point questions and 0.83 for four-point questions. Based on the research findings and discussion, it can be concluded that the developed evaluation instrument for minimum competencies in conceptual understanding and real-life application demonstrates good validity and reliability. This study has the potential to significantly contribute to a more holistic evaluation of education.</dc:description>
	<dc:publisher xml:lang="en">Universitas Negeri Semarang</dc:publisher>
	<dc:date>2024-03-30</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.unnes.ac.id/journals/jere/article/view/6633</dc:identifier>
	<dc:source xml:lang="en">Journal of Research and Educational Research Evaluation; Vol. 13 No. 1 (2024): March 2024; 73-84</dc:source>
	<dc:source>2503-1732</dc:source>
	<dc:source>2252-6420</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.unnes.ac.id/journals/jere/article/view/6633/1122</dc:relation>
	<dc:rights xml:lang="en">Copyright (c) 2024 Journal of Research and Educational Research Evaluation</dc:rights>
</oai_dc:dc>