Melola Discovery

← Melola Discovery

Journal No SINTA rank

Evaluating Validity and Reliability of Scientific Literacy Among Indonesian Secondary Students in PISA 2015 Context: Rasch Model Analysis

Journal of Research and Educational Research Evaluation · Vol. 13 No. 2 (2024) · pp. 169–179

ISSN
2503-1732, 2252-6420
Published
2024-08-30
Publisher
Universitas Negeri Semarang
Language
eng

Abstract

Indonesia has followed the Scientific Literacy Test in PISA OECD and the rank is at the bottom. Scientific literacy is important things in science education because it involves the skills of scientific thinking in society life. This study aims to find the validity and reliability of scientific literacy in PISA 2015 using the Rasch model. The method of this research used quantitative survey research that assessed 15 years of 92 secondary school students. The validity in general shows the test items are not valid, but the validity in each test item shows 17 of 20 questions are valid. Reliability in person is lower than reliability in items. Even though, the test items still have good quality from the reliability findings. The novelty of this study is the validity and reliability of the PISA 2015 test items in Indonesian students as the sample. PISA 2015 used scientific literacy as the dominant test at that time. This study has benefitted other researchers by showing the importance of the validity and reliability of the instruments and ensuring the quality of the instruments for other researchers who will conduct future research using good validity and reliable instruments.

Keywords

Collaboration network of the authors

3 authors · 3 co-authorship links

Hover or tap a name to highlight its co-authors. Double-click to open the author's page.

  • Affiliation unknown
  • Different organisations
  • Same organisation
  • Affiliation unknown
  • Thicker line = more joint articles · bigger circle = more articles
Show as table
Co-authorOrganisationJoint articles

Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.

Metadata source: OAI-PMH (metadata jurnal) https://journal.unnes.ac.id/journals/jere/oai, first harvested 6 Nov 2026, last seen 8 Nov 2026.
Original metadata (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en">Evaluating Validity and Reliability of Scientific Literacy Among Indonesian Secondary Students in PISA 2015 Context: Rasch Model Analysis</dc:title>
	<dc:creator xml:lang="en">Saputra, Winata Tegar Saputra</dc:creator>
	<dc:creator xml:lang="en">Nuryani Rustaman</dc:creator>
	<dc:creator xml:lang="en">Lilit Rusyati</dc:creator>
	<dc:subject xml:lang="en">Scientific Literacy</dc:subject>
	<dc:subject xml:lang="en">Rasch Model</dc:subject>
	<dc:subject xml:lang="en">Validity</dc:subject>
	<dc:subject xml:lang="en">Reliability</dc:subject>
	<dc:subject xml:lang="en">Instrument</dc:subject>
	<dc:description xml:lang="en">Indonesia has followed the Scientific Literacy Test in PISA OECD and the rank is at the bottom. Scientific literacy is important things in science education because it involves the skills of scientific thinking in society life. This study aims to find the validity and reliability of scientific literacy in PISA 2015 using the Rasch model. The method of this research used quantitative survey research that assessed 15 years of 92 secondary school students. The validity in general shows the test items are not valid, but the validity in each test item shows 17 of 20 questions are valid. Reliability in person is lower than reliability in items. Even though, the test items still have good quality from the reliability findings. The novelty of this study is the validity and reliability of the PISA 2015 test items in Indonesian students as the sample. PISA 2015 used scientific literacy as the dominant test at that time. This study has benefitted other researchers by showing the importance of the validity and reliability of the instruments and ensuring the quality of the instruments for other researchers who will conduct future research using good validity and reliable instruments.</dc:description>
	<dc:publisher xml:lang="en">Universitas Negeri Semarang</dc:publisher>
	<dc:date>2024-08-30</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.unnes.ac.id/journals/jere/article/view/7387</dc:identifier>
	<dc:source xml:lang="en">Journal of Research and Educational Research Evaluation; Vol. 13 No. 2 (2024): August 2024; 169-179</dc:source>
	<dc:source>2503-1732</dc:source>
	<dc:source>2252-6420</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.unnes.ac.id/journals/jere/article/view/7387/1940</dc:relation>
	<dc:rights xml:lang="en">Copyright (c) 2024 Journal of Research and Educational Research Evaluation</dc:rights>
</oai_dc:dc>