Melola Discovery

← Melola Discovery

Jurnal Tanpa peringkat SINTA

Review: A Hybrid Approach of Aspect-Based Sentiment Analysis and Knowledge Extraction for Evaluating Security Perceptions in Digital Payment Applications

Scientific Journal of Informatics · Vol. 12 No. 4 (2025) · hlm. 635–650

DOI
10.15294/sji.v12i4.31557
ISSN
2407-7658, 2460-0040
Terbit
2025-11-19
Penerbit
Universitas Negeri Semarang
Bahasa
eng

Abstrak

Purpose: The rapid expansion of digital wallets in Indonesia has heightened concerns regarding user security and trust. This study evaluates user sentiment toward the security features of the DANA digital payment application using Aspect Sentiment Classification (ASC), a subtask of Aspect-Based Sentiment Analysis (ABSA). It aims to compare multiple classification models and generate structured, machine-readable sentiment outputs to support knowledge extraction and system integration. Methods: A total of 4,846 security-related reviews were collected from the Google Play Store using keyword-based filtering, supplemented by 3,000 unfiltered reviews for robustness evaluation. Sentiment labeling was performed using a hybrid rule-based and manual annotation approach. From 300 proportionally sampled reviews (150 positive and 150 negative), the validation achieved 0.8504 accuracy and a Cohen’s κ of 0.951, indicating near-perfect agreement. Five models Support Vector Machine (SVM), Random Forest (RF), Convolutional Neural Network (CNN), Bidirectional Long Short-Term Memory (BiLSTM), and IndoBERT were evaluated using 5-fold stratified cross-validation with random oversampling to address class imbalance. Result: IndoBERT achieved the highest performance with 98% accuracy, an F1-score of 0.974, and an AUC-ROC of 0.996, followed by CNN and BiLSTM. Robustness testing across temporal (DANA June–October) and cross-domain (GoPay) datasets confirmed IndoBERT’s strong generalization with minimal F1-score variation. Novelty: Unlike previous ABSA studies that addressed multiple aspects, this research focuses exclusively on the security aspect, providing fine-grained insights into user trust. The integration of XML-based structured output enhances interpretability and interoperability in digital financial sentiment analysis, contributing to the development of more secure and transparent fintech ecosystems.

Kata kunci

Jaringan kolaborasi para penulis

3 penulis · 2 tautan kepenulisan bersama

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Sriwijaya University
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Luthfiah MufidahSriwijaya University1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) https://journal.unnes.ac.id/journals/sji/oai, pertama di-harvest 6 Nov 2026, terakhir terlihat 8 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en">Review: A Hybrid Approach of Aspect-Based Sentiment Analysis and Knowledge Extraction for Evaluating Security Perceptions in Digital Payment Applications</dc:title>
	<dc:creator xml:lang="en">Fatihaturrahmah, Aisyah</dc:creator>
	<dc:creator xml:lang="en">Tania, Ken Ditha</dc:creator>
	<dc:subject xml:lang="en">Aspect-based sentiment analysis (ABSA)</dc:subject>
	<dc:subject xml:lang="en">Security</dc:subject>
	<dc:subject xml:lang="en">Sentiment classification</dc:subject>
	<dc:subject xml:lang="en">Machine learning</dc:subject>
	<dc:subject xml:lang="en">Deep learning</dc:subject>
	<dc:subject xml:lang="en">Knowledge extraction</dc:subject>
	<dc:description xml:lang="en">Purpose: The rapid expansion of digital wallets in Indonesia has heightened concerns regarding user security and trust. This study evaluates user sentiment toward the security features of the DANA digital payment application using Aspect Sentiment Classification (ASC), a subtask of Aspect-Based Sentiment Analysis (ABSA). It aims to compare multiple classification models and generate structured, machine-readable sentiment outputs to support knowledge extraction and system integration.
Methods: A total of 4,846 security-related reviews were collected from the Google Play Store using keyword-based filtering, supplemented by 3,000 unfiltered reviews for robustness evaluation. Sentiment labeling was performed using a hybrid rule-based and manual annotation approach. From 300 proportionally sampled reviews (150 positive and 150 negative), the validation achieved 0.8504 accuracy and a Cohen’s κ of 0.951, indicating near-perfect agreement. Five models Support Vector Machine (SVM), Random Forest (RF), Convolutional Neural Network (CNN), Bidirectional Long Short-Term Memory (BiLSTM), and IndoBERT were evaluated using 5-fold stratified cross-validation with random oversampling to address class imbalance.
Result: IndoBERT achieved the highest performance with 98% accuracy, an F1-score of 0.974, and an AUC-ROC of 0.996, followed by CNN and BiLSTM. Robustness testing across temporal (DANA June–October) and cross-domain (GoPay) datasets confirmed IndoBERT’s strong generalization with minimal F1-score variation.
Novelty: Unlike previous ABSA studies that addressed multiple aspects, this research focuses exclusively on the security aspect, providing fine-grained insights into user trust. The integration of XML-based structured output enhances interpretability and interoperability in digital financial sentiment analysis, contributing to the development of more secure and transparent fintech ecosystems.</dc:description>
	<dc:publisher xml:lang="en">Universitas Negeri Semarang</dc:publisher>
	<dc:date>2025-11-19</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.unnes.ac.id/journals/sji/article/view/31557</dc:identifier>
	<dc:identifier>10.15294/sji.v12i4.31557</dc:identifier>
	<dc:source xml:lang="en">Scientific Journal of Informatics; Vol. 12 No. 4: Special Issue; 635-650</dc:source>
	<dc:source>2407-7658</dc:source>
	<dc:source>2460-0040</dc:source>
	<dc:source>10.15294/sji.v12i4</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.unnes.ac.id/journals/sji/article/view/31557/7538</dc:relation>
	<dc:rights xml:lang="en">Copyright (c) 2025 Scientific Journal of Informatics</dc:rights>
</oai_dc:dc>