Melola Discovery

← Melola Discovery

Open access Journal

INTEGRATING AN LLM-BASED CYBERSECURITY CONSULTATION LAYER INTO A NATIONAL AWARENESS BENCHMARKING SYSTEM

Jurnal Ilmiah Ilmu Terapan Universitas Jambi · Vol. 10 No. 2 (2026) · pp. 898–914

DOI
10.22437/jiituj.v10i2.53435
ISSN
2580-2259, 2580-2240
Published
2026-04-30
Publisher
LPPM Universitas Jambi
Language
en
License
creativecommons.org/licenses/by/4.0

Abstract

This study integrates a large language model (LLM) consultation service into Indonesia’s national Cyber Security Awareness Survey (“Survei Kesadaran Keamanan Siber”/SKKS) to convert survey benchmarking into immediate, personalized cybersecurity remediation, and evaluates its safety, usability, and potential short-term proximal intention shift among Generation Z respondents. Using a two-phase, multi-method design, Phase I conducted a model-centric expert evaluation of LLM-generated recommendations across 20 standardized synthetic SKKS profiles, assessing relevance, accuracy, completeness, clarity, and safety. Phase II implemented a single-session within-subject study (N = 104) that measured post-interaction user experience and pre–post changes in security behavior intentions using an adapted Security Behavior Intentions Scale (SeBIS). Expert results showed consistently high ratings across dimensions (all means > 4.0/5) with no safety veto triggers and strong inter-rater reliability (ICC[2,k] = 0.82–1.00). Users reported positive experience (means ≈ 3.84–3.96/5), sustained engagement, and a significant increase in SeBIS total score (dz = 0.42), with the largest gains in password-management intentions. Novelty lies in embedding LLM-based, profile-driven consultation within a national-scale awareness survey and validating it through both expert human review and behavioral-intention measurement. Beyond cybersecurity, this work contributes to the broader literature on AI-mediated educational systems in safety-critical domains by demonstrating how adaptive dialogue systems can operationalize assessment-to-action loops and support scalable, human-centered personalization.

Keywords

Collaboration network of the authors

5 authors · 6 co-authorship links

Hover or tap a name to highlight its co-authors. Double-click to open the author's page.

  • Politeknik Siber dan Sandi Negara
  • Different organisations
  • Same organisation
  • Affiliation unknown
  • Thicker line = more joint articles · bigger circle = more articles
Show as table
Co-authorOrganisationJoint articles
Amiruddin AmiruddinPoliteknik Siber dan Sandi Negara1
Wiyar Wilujengning SejatiPoliteknik Siber dan Sandi Negara1

Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.

Metadata source: OAI-PMH (metadata jurnal) https://online-journal.unja.ac.id/index.php/JIITUJ/oai, first harvested 5 Nov 2026, last seen 8 Nov 2026.
Original metadata (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en">INTEGRATING AN LLM-BASED CYBERSECURITY CONSULTATION LAYER INTO A NATIONAL AWARENESS BENCHMARKING SYSTEM</dc:title>
	<dc:creator xml:lang="en">Hadiprakoso, Raden Budiarto</dc:creator>
	<dc:creator xml:lang="en">Dramaga, Rakhmat</dc:creator>
	<dc:creator xml:lang="en">Qomariasih, Nurul</dc:creator>
	<dc:subject xml:lang="en">Cybersecurity Awareness</dc:subject>
	<dc:subject xml:lang="en">Human–AI Evaluation</dc:subject>
	<dc:subject xml:lang="en">Personalized Learning</dc:subject>
	<dc:subject xml:lang="en">Large Language Models (LLMs)</dc:subject>
	<dc:subject xml:lang="en">Security Behavior Intentions (SeBIS)</dc:subject>
	<dc:description xml:lang="en">This study integrates a large language model (LLM) consultation service into Indonesia’s national Cyber Security Awareness Survey (“Survei Kesadaran Keamanan Siber”/SKKS) to convert survey benchmarking into immediate, personalized cybersecurity remediation, and evaluates its safety, usability, and potential short-term proximal intention shift among Generation Z respondents. Using a two-phase, multi-method design, Phase I conducted a model-centric expert evaluation of LLM-generated recommendations across 20 standardized synthetic SKKS profiles, assessing relevance, accuracy, completeness, clarity, and safety. Phase II implemented a single-session within-subject study (N = 104) that measured post-interaction user experience and pre–post changes in security behavior intentions using an adapted Security Behavior Intentions Scale (SeBIS). Expert results showed consistently high ratings across dimensions (all means &amp;gt; 4.0/5) with no safety veto triggers and strong inter-rater reliability (ICC[2,k] = 0.82–1.00). Users reported positive experience (means ≈ 3.84–3.96/5), sustained engagement, and a significant increase in SeBIS total score (dz = 0.42), with the largest gains in password-management intentions. Novelty lies in embedding LLM-based, profile-driven consultation within a national-scale awareness survey and validating it through both expert human review and behavioral-intention measurement. Beyond cybersecurity, this work contributes to the broader literature on AI-mediated educational systems in safety-critical domains by demonstrating how adaptive dialogue systems can operationalize assessment-to-action loops and support scalable, human-centered personalization.</dc:description>
	<dc:publisher xml:lang="en">LPPM Universitas Jambi</dc:publisher>
	<dc:date>2026-04-30</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://online-journal.unja.ac.id/JIITUJ/article/view/53435</dc:identifier>
	<dc:identifier>10.22437/jiituj.v10i2.53435</dc:identifier>
	<dc:source xml:lang="en">Jurnal Ilmiah Ilmu Terapan Universitas Jambi; Vol. 10 No. 2 (2026): Volume 10, Nomor 2, April 2026; 898-914</dc:source>
	<dc:source>2580-2259</dc:source>
	<dc:source>2580-2240</dc:source>
	<dc:language>en</dc:language>
	<dc:relation>https://online-journal.unja.ac.id/JIITUJ/article/view/53435/24146</dc:relation>
	<dc:rights xml:lang="en">Copyright (c) 2026 Raden Budiarto Hadiprakoso, Rakhmat Dramaga, Nurul Qomariasih</dc:rights>
	<dc:rights xml:lang="en">https://creativecommons.org/licenses/by/4.0</dc:rights>
</oai_dc:dc>