Validity and Reliability of Online Socio-Scientific Issue-Based Critical Reasoning Instrument

yokhebed, yokhebed; Sutarno, Sutarno; Masykuri, Mohammad; Adi Prayitno, Baskoro; sudirman, sudirman

doi:10.15294/2hnw4674

Jurnal SINTA 1

Validity and Reliability of Online Socio-Scientific Issue-Based Critical Reasoning Instrument

Jurnal Pendidikan IPA Indonesia · Vol. 13 No. 2 (2024)

DOI: 10.15294/2hnw4674
ISSN: 2089-4392, 2339-1286
Published: 2024-06-30
Publisher: Universitas Negeri Semarang
Language: eng

Abstract

Information regarding the evaluation of reasoning skills related to online socio-scientific issues is still limited due to limited instruments. This research aims to determine the validity and reliability of an online socio-scientific issue-based critical reasoning instrument. Content validity was proven by the assessment method by five experts. Confirmatory factor analysis was carried out with the Lisrel 8.8 program to prove construct validity. Instrument testing was carried out on 145 grade 10 high school students. Convergent validity was determined through the Average Variance Extracted (AVE) calculation, and reliability was determined through Construct Reliability (CR). There are 12 items from four dimensions of critical reasoning based on online socio-scientific issues: (1) evaluating SSI information, (2) identifying SSI complexity, (3) checking the credibility of information sources, and (4) multiperspective. The results of the content validity test obtained the Aiken coefficient value in the valid category. Based on the analysis results, the GFI, RMSEA, and p-value of the instrument fit the model and have loading factors that meet the minimum criteria. In addition, the instrument meets convergent validity and internal consistency. Thus, it is concluded that the instrument is declared valid and reliable and can be used to measure critical reasoning based on online socio-scientific issues.

Keywords

Collaboration network of the authors

19 authors · 44 co-authorship links · 8 across different organisations

Hover or tap a name to highlight its co-authors. Double-click to open the author's page.

Sebelas Maret University
Southwest University
Universiti of Malaysia Sabah
Affiliation unknown

Different organisations
Same organisation
Affiliation unknown
Thicker line = more joint articles · bigger circle = more articles

Show as table

Co-author	Organisation	Joint articles
Widha Sunarno	Sebelas Maret University	1
Yetty Trisnayanti	Sebelas Maret University	1
S Sukarmin	Sebelas Maret University	1
Zuhair Jamain	Universiti of Malaysia Sabah	1
Sajidan Sajidan	Sebelas Maret University	1
Suranto Suranto	Sebelas Maret University	1
Riezky Maya Probosari	Sebelas Maret University	1
Bartolomeus Kristi Brahmantia Putra	Sebelas Maret University	1
Mr Maridi	Sebelas Maret University	1
Sigit Prastowo	Affiliation unknown	1
Shavya Sarah Saviera	Affiliation unknown	1
Rebecca Vanessa	Affiliation unknown	1
Galih Pambuko	Affiliation unknown	1
Ari Susilowati	Affiliation unknown	1

Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.

Metadata source: OAI-PMH (metadata jurnal) https://journal.unnes.ac.id/journals/jpii/oai, first harvested 29 Okt 2026, last seen 29 Okt 2026.

Original metadata (oai_dc)

<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en">Validity and Reliability of Online Socio-Scientific Issue-Based Critical Reasoning Instrument</dc:title>
	<dc:creator xml:lang="en">yokhebed, yokhebed</dc:creator>
	<dc:creator xml:lang="en">Sutarno, Sutarno</dc:creator>
	<dc:creator xml:lang="en">Masykuri, Mohammad</dc:creator>
	<dc:creator xml:lang="en">Adi Prayitno, Baskoro</dc:creator>
	<dc:creator xml:lang="en">sudirman , sudirman </dc:creator>
	<dc:subject xml:lang="en">critical reasoning; instrument; online; reliability; socio-scientific issue; validity</dc:subject>
	<dc:description xml:lang="en">Information regarding the evaluation of reasoning skills related to online socio-scientific issues is still limited due to limited instruments. This research aims to determine the validity and reliability of an online socio-scientific issue-based critical reasoning instrument. Content validity was proven by the assessment method by five experts. Confirmatory factor analysis was carried out with the Lisrel 8.8 program to prove construct validity. Instrument testing was carried out on 145 grade 10 high school students. Convergent validity was determined through the Average Variance Extracted (AVE) calculation, and reliability was determined through Construct Reliability (CR). There are 12 items from four dimensions of critical reasoning based on online socio-scientific issues: (1) evaluating SSI information, (2) identifying SSI complexity, (3) checking the credibility of information sources, and (4) multiperspective. The results of the content validity test obtained the Aiken coefficient value in the valid category. Based on the analysis results, the GFI, RMSEA, and p-value of the instrument fit the model and have loading factors that meet the minimum criteria. In addition, the instrument meets convergent validity and internal consistency. Thus, it is concluded that the instrument is declared valid and reliable and can be used to measure critical reasoning based on online socio-scientific issues.</dc:description>
	<dc:publisher xml:lang="en">Universitas Negeri Semarang</dc:publisher>
	<dc:date>2024-06-30</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.unnes.ac.id/journals/jpii/article/view/4208</dc:identifier>
	<dc:identifier>10.15294/2hnw4674</dc:identifier>
	<dc:source xml:lang="en">Jurnal Pendidikan IPA Indonesia; Vol. 13 No. 2 (2024): June 2024</dc:source>
	<dc:source>2089-4392</dc:source>
	<dc:source>2339-1286</dc:source>
	<dc:source>10.15294/jpii.v13i2</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.unnes.ac.id/journals/jpii/article/view/4208/1031</dc:relation>
	<dc:rights xml:lang="en">Copyright (c) 2024 Jurnal Pendidikan IPA Indonesia</dc:rights>
</oai_dc:dc>