Using Multilevel Modelling to Evaluate Science Literacy and Technology Course of the Indonesian Non-Science Students

Setiaji, B.; Santoso, P. H.; Aziz, K. N.; Retnawati, H.; Khairudin, M.

doi:10.15294/jpii.v12i1.41457

Jurnal SINTA 1

Using Multilevel Modelling to Evaluate Science Literacy and Technology Course of the Indonesian Non-Science Students

Jurnal Pendidikan IPA Indonesia · Vol. 12 No. 1 (2023) · pp. 96–111

DOI: 10.15294/jpii.v12i1.41457
ISSN: 2089-4392, 2339-1286
Published: 2023-03-30
Publisher: Program Studi Pendidikan IPA Fakultas Matematika dan Ilmu Pengetahuan Alam (FMIPA)
Language: eng

Abstract

In this paper, a science literacy and technology course has been designed and implemented to strengthen the national initiative empowering scientifically literate Indonesian society. This paper is intended to evaluate to what degree non-science undergraduate students can perform this course. The diverse background of non-science students who participated in this study led to the challenge to evaluate their performance more comprehensively contemplating the nested structure of students’ department and faculty setting. In light of the hierarchical nature of the student data, multilevel modelling was used to conduct the analysis. The first level of analysis involved students’ performance and affective attributes measured using demonstrated science literacy assessment (SLA-D) and motivational beliefs (SLA-MB) respectively. Then, the subsequent level of analysis comprised demographic factors gathered from the institutional record. Findings demonstrated that the impact of demographic factors on the students’ performance of science literacy was not substantial. Different settings of students’ department and faculty level drove the association between affective factors and the learning process toward science literacy courses substantially. The multilevel approach controlled the equitable student assessment within the nature of students’ data structure. This paper suggests an implication of advancement regarding educational data analysis and examines the effectiveness of science literacy courses for higher institutions specifically for non-science majors.

Keywords

Collaboration network of the authors

15 authors · 41 co-authorship links · 18 across different organisations

Hover or tap a name to highlight its co-authors. Double-click to open the author's page.

Yogyakarta State University
Universitas Sulawesi Barat
National Central University
Webster University
National Research and Innovation Agency
Affiliation unknown

Different organisations
Same organisation
Affiliation unknown
Thicker line = more joint articles · bigger circle = more articles

Show as table

Co-author	Organisation	Joint articles
G.D. Chen	National Central University	1
M.C. Wu	Affiliation unknown	1
Rustam Asnawi	Yogyakarta State University	1
Nurkhamid Nurkhamid	Yogyakarta State University	1
Janu Arlinwibowo	National Research and Innovation Agency	1
Bayuk Nusantara	Yogyakarta State University	1
Samsul Hadi	Yogyakarta State University	1
Sumaryanto Sumaryanto	Yogyakarta State University	1
Lantip Diat Prasojo	Yogyakarta State University	1
Rimajon Sotlikova	Webster University	1

Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.

Metadata source: OAI-PMH (metadata jurnal) https://journal.unnes.ac.id/nju/index.php/jpii/oai, first harvested 29 Okt 2026, last seen 1 Nov 2026.

Original metadata (oai_dc)

<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Using Multilevel Modelling to Evaluate Science Literacy and Technology Course of the Indonesian Non-Science Students</dc:title>
	<dc:creator>Setiaji, B.</dc:creator>
	<dc:creator>Santoso, P. H.</dc:creator>
	<dc:creator>Aziz, K. N.</dc:creator>
	<dc:creator>Retnawati, H.</dc:creator>
	<dc:creator>Khairudin, M.</dc:creator>
	<dc:subject xml:lang="en-US">multilevel modeling; non-science students; science literacy</dc:subject>
	<dc:description xml:lang="en-US">In this paper, a science literacy and technology course has been designed and implemented to strengthen the national initiative empowering scientifically literate Indonesian society. This paper is intended to evaluate to what degree non-science undergraduate students can perform this course. The diverse background of non-science students who participated in this study led to the challenge to evaluate their performance more comprehensively contemplating the nested structure of students’ department and faculty setting. In light of the hierarchical nature of the student data, multilevel modelling was used to conduct the analysis. The first level of analysis involved students’ performance and affective attributes measured using demonstrated science literacy assessment (SLA-D) and motivational beliefs (SLA-MB) respectively. Then, the subsequent level of analysis comprised demographic factors gathered from the institutional record. Findings demonstrated that the impact of demographic factors on the students’ performance of science literacy was not substantial. Different settings of students’ department and faculty level drove the association between affective factors and the learning process toward science literacy courses substantially. The multilevel approach controlled the equitable student assessment within the nature of students’ data structure. This paper suggests an implication of advancement regarding educational data analysis and examines the effectiveness of science literacy courses for higher institutions specifically for non-science majors.</dc:description>
	<dc:publisher xml:lang="en-US">Program Studi Pendidikan IPA Fakultas Matematika dan Ilmu Pengetahuan Alam (FMIPA)</dc:publisher>
	<dc:contributor xml:lang="en-US"></dc:contributor>
	<dc:date>2023-03-30</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.unnes.ac.id/nju/jpii/article/view/41457</dc:identifier>
	<dc:identifier>10.15294/jpii.v12i1.41457</dc:identifier>
	<dc:source xml:lang="en-US">Jurnal Pendidikan IPA Indonesia; Vol 12, No 1 (2023): March 2023; 96-111</dc:source>
	<dc:source>2089-4392</dc:source>
	<dc:source>2339-1286</dc:source>
	<dc:source>10.15294/jpii.v12i1</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.unnes.ac.id/nju/jpii/article/view/41457/14303</dc:relation>
	<dc:relation>https://journal.unnes.ac.id/nju/jpii/article/downloadSuppFile/41457/11508</dc:relation>
	<dc:relation>https://journal.unnes.ac.id/nju/jpii/article/downloadSuppFile/41457/11512</dc:relation>
	<dc:relation>https://journal.unnes.ac.id/nju/jpii/article/downloadSuppFile/41457/11515</dc:relation>
	<dc:relation>https://journal.unnes.ac.id/nju/jpii/article/downloadSuppFile/41457/11523</dc:relation>
	<dc:relation>https://journal.unnes.ac.id/nju/jpii/article/downloadSuppFile/41457/11529</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2023 Jurnal Pendidikan IPA Indonesia</dc:rights>
</oai_dc:dc>