Melola Discovery

← Melola Discovery

Open access Journal

Comparative Analysis of Naive Bayes and Support Vector Machine for Sentiment Analysis of Mobile Banking Application Reviews in Indonesia

Journal of Advances in Information Systems and Technology · Vol. 8 No. 1 (2026)

DOI
10.15294/jaist.v8i1.48426
ISSN
2715-999X, 2714-9714
Published
2026-05-13
Publisher
Universitas Negeri Semarang
Language
eng
License
creativecommons.org/licenses/by-sa/4.0/

Abstract

This study aims to analyze user sentiment toward mobile banking applications in Indonesia using machine learning approaches and to compare the performance of Naive Bayes and Support Vector Machine (SVM) algorithms. The dataset was collected through scraping user reviews from Google Play Store, focusing on three major mobile banking applications: BCA Mobile, Livin by Mandiri, and BRImo. The research methodology includes data preprocessing (case folding, cleaning, and stemming), feature extraction using Term Frequency–Inverse Document Frequency (TF-IDF), optional feature selection using Chi-Square, and classification using Naive Bayes and SVM. The performance of each model was evaluated using accuracy, precision, recall, and F1-score metrics. The experimental results show that the SVM algorithm achieved the highest accuracy of 89.80%, outperforming Naive Bayes, which achieved 86.22%. Meanwhile, the application of Chi-Square feature selection did not significantly improve model performance and slightly reduced accuracy to 85.71%. These findings indicate that SVM is more effective in handling high-dimensional text data for sentiment classification tasks, while TF-IDF representation alone is sufficient without additional feature selection. This study contributes to the evaluation of machine learning methods for sentiment analysis in mobile banking applications and provides insights for improving digital banking services based on user feedback.

Keywords

Collaboration network of the authors

8 authors · 22 co-authorship links · 1 across different organisations

Hover or tap a name to highlight its co-authors. Double-click to open the author's page.

  • IAIN Kudus
  • Universitas Islam Negeri Ar-Raniry
  • Affiliation unknown
  • Different organisations
  • Same organisation
  • Affiliation unknown
  • Thicker line = more joint articles · bigger circle = more articles
Show as table
Co-authorOrganisationJoint articles
Iqbal FirdausAffiliation unknown1
Muhammad YunanAffiliation unknown1
Novia UrfiyatiAffiliation unknown1
Maisarah MaisarahUniversitas Islam Negeri Ar-Raniry1
Yeni Agus NurhudaAffiliation unknown1
Naufal IlhamAffiliation unknown1

Affiliations come from OpenAlex; journal OAI-PMH metadata carries none. Authors without an OpenAlex ID are matched by name, which can merge or split people.

Metadata source: OAI-PMH (metadata jurnal) https://journal.unnes.ac.id/journals/jaist/oai, first harvested 6 Nov 2026, last seen 8 Nov 2026.
Original metadata (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en">Comparative Analysis of Naive Bayes and Support Vector Machine for Sentiment Analysis of Mobile Banking Application Reviews in Indonesia</dc:title>
	<dc:creator xml:lang="en">Mandaya, Yusuf Wisnu </dc:creator>
	<dc:creator xml:lang="en">Fajri, Laksamana Rajendra Haidar Azani</dc:creator>
	<dc:subject xml:lang="en">Sentiment Analysis</dc:subject>
	<dc:subject xml:lang="en">Naive Bayes</dc:subject>
	<dc:subject xml:lang="en">Support Vector Machine</dc:subject>
	<dc:subject xml:lang="en">Mobile Banking</dc:subject>
	<dc:subject xml:lang="en">Text Mining</dc:subject>
	<dc:description xml:lang="en">This study aims to analyze user sentiment toward mobile banking applications in Indonesia using machine learning approaches and to compare the performance of Naive Bayes and Support Vector Machine (SVM) algorithms. The dataset was collected through scraping user reviews from Google Play Store, focusing on three major mobile banking applications: BCA Mobile, Livin by Mandiri, and BRImo. The research methodology includes data preprocessing (case folding, cleaning, and stemming), feature extraction using Term Frequency–Inverse Document Frequency (TF-IDF), optional feature selection using Chi-Square, and classification using Naive Bayes and SVM. The performance of each model was evaluated using accuracy, precision, recall, and F1-score metrics. The experimental results show that the SVM algorithm achieved the highest accuracy of 89.80%, outperforming Naive Bayes, which achieved 86.22%. Meanwhile, the application of Chi-Square feature selection did not significantly improve model performance and slightly reduced accuracy to 85.71%. These findings indicate that SVM is more effective in handling high-dimensional text data for sentiment classification tasks, while TF-IDF representation alone is sufficient without additional feature selection. This study contributes to the evaluation of machine learning methods for sentiment analysis in mobile banking applications and provides insights for improving digital banking services based on user feedback. </dc:description>
	<dc:publisher xml:lang="en">Universitas Negeri Semarang</dc:publisher>
	<dc:date>2026-05-13</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.unnes.ac.id/journals/jaist/article/view/48426</dc:identifier>
	<dc:identifier>10.15294/jaist.v8i1.48426</dc:identifier>
	<dc:source xml:lang="en">Journal of Advances in Information Systems and Technology; Vol. 8 No. 1 (2026): April</dc:source>
	<dc:source>2715-999X</dc:source>
	<dc:source>2714-9714</dc:source>
	<dc:source>10.15294/jaist.v8i1</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.unnes.ac.id/journals/jaist/article/view/48426/9697</dc:relation>
	<dc:rights xml:lang="en">Copyright (c) 2026 Journal of Advances in Information Systems and Technology</dc:rights>
	<dc:rights xml:lang="en">https://creativecommons.org/licenses/by-sa/4.0/</dc:rights>
</oai_dc:dc>