Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Toward Real-Time Hoax Detection: Integrating Transformer for News Scraping and Semantic Analysis

Journal of Information Systems Engineering and Business Intelligence · Vol. 12 No. 2 (2026) · hlm. 348–360

DOI
10.20473/jisebi.12.2.348-360
ISSN
2443-2555, 2598-6333
Terbit
2026-07-07
Penerbit
Universitas Airlangga
Bahasa
eng
Lisensi
creativecommons.org/licenses/by/4.0

Abstrak

Background: Social media has become one of the primary sources of information for the public, but it is also vulnerable to fake news (hoaxes). Various supervised learning approaches have been used for hoax detection; however, they generally depend on labeled data availability and require retraining to handle new claims. Objective: This study implements and evaluates a zero-shot inference-based hoax verification pipeline capable of verifying claims in near real-time without model retraining. Methods: The study uses a computational experiment approach consisting of four stages: (1) construction of a test claim dataset through paraphrasing using the NLLB-200, T5, and mT5 models; (2) keyword extraction using KeyBERT with IndoBERT embeddings and parameter optimization; (3) news article summarization using IndoBART; and (4) semantic similarity analysis by comparing Multilingual-E5, BGE, LaBSE, SBERT, IndoBERT, and TF-IDF as the baseline. Results: In the keyword extraction stage, the best balance between relevance, redundancy, and keyword coverage was achieved using the hybrid configuration of Top-k = 12, Top-p = 0.85, MMR = 0.6, and Ctx = 2. In the verification stage, Multilingual-E5 delivered the highest performance, achieving an accuracy of 0.96 and an F1-score of 0.94. In contrast, IndoBERT produced the lowest results, particularly for paraphrased claims. TF-IDF achieved good performance on original claims but experienced a decline when semantic variations were handled. Article summarization helped reduce article length, although this stage removed part of the information relevant to the verification process in some cases. Conclusion: The results of this study show that the zero-shot inference-, retrieval-, and semantic similarity-based approaches are capable of verifying hoaxes with high accuracy while maintaining stable performance across various claim variations. This approach offers greater flexibility for handling new claims than supervised learning methods and is suitable for application in near real-time hoax verification systems. Keywords: hoax verification, keyword extraction, semantic similarity, summarization, zero-shot inference

Jaringan kolaborasi para penulis

5 penulis · 5 tautan kepenulisan bersama

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Universitas Handayani Makassar
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Billy Eden William AsrulUniversitas Handayani Makassar2
Pujianti WahyuningsihUniversitas Handayani Makassar1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) https://e-journal.unair.ac.id/JISEBI/oai, pertama di-harvest 29 Okt 2026, terakhir terlihat 15 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Toward Real-Time Hoax Detection: Integrating Transformer for News Scraping and Semantic Analysis</dc:title>
	<dc:creator>Nur, M. Adnan</dc:creator>
	<dc:creator>Herlinah</dc:creator>
	<dc:creator>Zuhriyah, Sitti</dc:creator>
	<dc:description xml:lang="en-US">Background: Social media has become one of the primary sources of information for the public, but it is also vulnerable to fake news (hoaxes). Various supervised learning approaches have been used for hoax detection; however, they generally depend on labeled data availability and require retraining to handle new claims.
Objective: This study implements and evaluates a zero-shot inference-based hoax verification pipeline capable of verifying claims in near real-time without model retraining.
Methods: The study uses a computational experiment approach consisting of four stages: (1) construction of a test claim dataset through paraphrasing using the NLLB-200, T5, and mT5 models; (2) keyword extraction using KeyBERT with IndoBERT embeddings and parameter optimization; (3) news article summarization using IndoBART; and (4) semantic similarity analysis by comparing Multilingual-E5, BGE, LaBSE, SBERT, IndoBERT, and TF-IDF as the baseline.
Results: In the keyword extraction stage, the best balance between relevance, redundancy, and keyword coverage was achieved using the hybrid configuration of Top-k = 12, Top-p = 0.85, MMR = 0.6, and Ctx = 2. In the verification stage, Multilingual-E5 delivered the highest performance, achieving an accuracy of 0.96 and an F1-score of 0.94. In contrast, IndoBERT produced the lowest results, particularly for paraphrased claims. TF-IDF achieved good performance on original claims but experienced a decline when semantic variations were handled. Article summarization helped reduce article length, although this stage removed part of the information relevant to the verification process in some cases.
Conclusion: The results of this study show that the zero-shot inference-, retrieval-, and semantic similarity-based approaches are capable of verifying hoaxes with high accuracy while maintaining stable performance across various claim variations. This approach offers greater flexibility for handling new claims than supervised learning methods and is suitable for application in near real-time hoax verification systems.
 
Keywords: hoax verification, keyword extraction, semantic similarity, summarization, zero-shot inference</dc:description>
	<dc:publisher xml:lang="en-US">Universitas Airlangga</dc:publisher>
	<dc:date>2026-07-07</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:format>text/xml</dc:format>
	<dc:identifier>https://e-journal.unair.ac.id/JISEBI/article/view/78679</dc:identifier>
	<dc:identifier>10.20473/jisebi.12.2.348-360</dc:identifier>
	<dc:source xml:lang="en-US">Journal of Information Systems Engineering and Business Intelligence; Vol. 12 No. 2 (2026):  June; 348-360</dc:source>
	<dc:source>2443-2555</dc:source>
	<dc:source>2598-6333</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://e-journal.unair.ac.id/JISEBI/article/view/78679/38912</dc:relation>
	<dc:relation>https://e-journal.unair.ac.id/JISEBI/article/view/78679/39419</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2026 The Authors. Published by Universitas Airlangga.</dc:rights>
	<dc:rights xml:lang="en-US">http://creativecommons.org/licenses/by/4.0</dc:rights>
</oai_dc:dc>