Melola Discovery

← Melola Discovery

Journal

Validity of Content and Reliability of Inter-Rater Instruments Assessing Ability of Problem Solving

Journal of Research and Educational Research Evaluation · Vol. 9 No. 1 (2020) · pp. 1–7

DOI
10.15294/jere.v9i1.40423
ISSN
2503-1732, 2252-6420
Published
2020-03-31
Publisher
Universitas Negeri Semarang
Language
eng

Abstract

In general, problems that occur in the actual are the discovery of instruments that have not been tested for problem solving abilities. The aim of this research is to reveal the content validity and interrater reliability of the instrument for evaluating the problem solving abilities that have been prepared. The research method is used a quantitative description by 3 expert judgments, they are experts in research and evaluation, mathematics education experts, and mathematics teachers. The instrument was developed in the form of an expert observation sheet with 3 aspects of assessment, they are the aspect of content eligibility, construction aspects, and language aspects, which of each aspect has 4 categories, which are very relevant, relevant, quite relevant, and highly irrelevant. Data were analyzed using the Aiken's V formula to determine the level of instrument validity and to determine the level of consistency / constancy between assessors using Instraclass Correlation Coefficient (ICC) analysis with the help of SPSS version 23.0. the results of analysis of the content validity of all items valued above 0.3 which means that all aspects assessed by experts are valid. Interrater reliability test using ICC obtained a value of 0.516, which means that all aspects of the instrument for evaluating problem solving abilities that have been rated have a level of consistency. Thus, the instrument of problem-solving ability that has been tested for validity and reliability can be used by educators to determine the level of students' problem solving abilities appropriately.

Collaboration network of the authors

40 authors · 236 co-authorship links · 6 across different organisations · showing the 40 most connected

Hover or tap a name to highlight its co-authors. Double-click to open the author's page.

  • State University of Semarang
  • Universitas Airlangga
  • Walisongo State Islamic University
  • Affiliation unknown
  • Different organisations
  • Same organisation
  • Affiliation unknown
  • Thicker line = more joint articles · bigger circle = more articles
Show as table
Co-authorOrganisationJoint articles
Wardono WardonoAffiliation unknown14
Sri HaryaniAffiliation unknown12
Sigit PriatmokoState University of Semarang8
Masrukan MasrukanState University of Semarang8
Supriyadi SupriyadiAffiliation unknown8
Scolastika MarianiAffiliation unknown7
Sri WardaniState University of Semarang6
Kasmui KasmuiState University of Semarang6
Nanik WijayatiState University of Semarang6
Mulyono MulyonoAffiliation unknown6
Rochmad RochmadAffiliation unknown6
Sri NurhayatiState University of Semarang5
Iwan JunaediAffiliation unknown5
Tri Sri Noor AsihAffiliation unknown5
Ani RusilowatiState University of Semarang5
Murbangun NuswowatiState University of Semarang4
Eko Budi SusatyoAffiliation unknown4
Kristina WijayantiAffiliation unknown4
Harjito HarjitoAffiliation unknown4
Supartono SupartonoAffiliation unknown4
Jumaeri JumaeriAffiliation unknown4
Kasmadi Imam SupardiState University of Semarang4
Agung Tri PrasetyaState University of Semarang4
Sri Susilogati SumartiState University of Semarang4
Isnarto IsnartoAffiliation unknown4
Woro SumarniState University of Semarang3
Edy CahyonoState University of Semarang3
Triastuti SulistyaningsihAffiliation unknown3
Dwijanto DwijantoAffiliation unknown3
Zaenuri MasturAffiliation unknown3
Isti HidayahAffiliation unknown3
Walid WalidState University of Semarang3
Budi WaluyaAffiliation unknown3
Ami AriyaniAffiliation unknown3
Achmad BinadjaAffiliation unknown3
Hardi SuyitnoAffiliation unknown3
Apriliana DrastisiantiWalisongo State Islamic University2

Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.

Metadata source: OAI-PMH (metadata jurnal) https://journal.unnes.ac.id/sju/index.php/jere/oai, first harvested 6 Nov 2026, last seen 6 Nov 2026.
Original metadata (oai_dc) 
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Validity of Content and Reliability of Inter-Rater Instruments Assessing Ability of Problem Solving</dc:title>
	<dc:creator>Ulfah, Aini Azkiyatu</dc:creator>
	<dc:creator>Kartono, Kartono</dc:creator>
	<dc:creator>Susilaningsih, Endang</dc:creator>
	<dc:description xml:lang="en-US">In general, problems that occur in the actual are the discovery of instruments that have not been tested for problem solving abilities. The aim of this research is to reveal the content validity and interrater reliability of the instrument for evaluating the problem solving abilities that have been prepared. The research method is used a quantitative description by 3 expert judgments, they are experts in research and evaluation, mathematics education experts, and mathematics teachers. The instrument was developed in the form of an expert observation sheet with 3 aspects of assessment, they are the aspect of content eligibility, construction aspects, and language aspects, which of each aspect has 4 categories, which are very relevant, relevant, quite relevant, and highly irrelevant. Data were analyzed using the Aiken's V formula to determine the level of instrument validity and to determine the level of consistency / constancy between assessors using Instraclass Correlation Coefficient (ICC) analysis with the help of SPSS version 23.0. the results of analysis of the content validity of all items valued above 0.3 which means that all aspects assessed by experts are valid. Interrater reliability test using ICC obtained a value of 0.516, which means that all aspects of the instrument for evaluating problem solving abilities that have been rated have a level of consistency. Thus, the instrument of problem-solving ability that has been tested for validity and reliability can be used by educators to determine the level of students' problem solving abilities appropriately.</dc:description>
	<dc:publisher xml:lang="en-US">Universitas Negeri Semarang</dc:publisher>
	<dc:date>2020-03-31</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.unnes.ac.id/sju/jere/article/view/40423</dc:identifier>
	<dc:identifier>10.15294/jere.v9i1.40423</dc:identifier>
	<dc:source xml:lang="en-US">Journal of Research and Educational Research Evaluation; Vol 9 No 1 (2020); 1-7</dc:source>
	<dc:source>2503-1732</dc:source>
	<dc:source>2252-6420</dc:source>
	<dc:source>10.15294/jere.v9i1</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.unnes.ac.id/sju/jere/article/view/40423/16786</dc:relation>
</oai_dc:dc>