Melola Discovery

← Melola Discovery

Jurnal Tanpa peringkat SINTA

Integrating Fine-Tuned IndoBERT into a Conversational Chatbot for Automated Ticket Categorization

Scientific Journal of Informatics · Vol. 13 No. 4 (2026) · hlm. 875–884

DOI
10.15294/sji.v13i4.63341
ISSN
2407-7658, 2460-0040
Terbit
2026-11-03
Penerbit
Universitas Negeri Semarang
Bahasa
eng

Abstrak

Purpose: University IT service desks frequently face operational bottlenecks due to manual ticket classification and high incident volumes. This study aims to develop an automated ticket categorization workflow by fine-tuning the IndoBERT model and embedding it into an interactive chatbot for real-time ticket categorization. Methods: A dataset of 6,192 Indonesian-language service desk tickets was divided into training (70%), validation (15%), and test (15%) sets. Class-weighted training was applied to address class imbalance, while grid search was performed to optimize the learning rate, batch size, and number of training epochs. The optimal model was then integrated into the Rasa conversational framework via custom actions and connected to the existing web-based service desk through a REST API, with Telegram serving as the user interface. Result: Fine-tuned IndoBERT achieved a test accuracy of 92.03% and a macro- and weighted-average F1-score of approximately 0.92, outperforming SVM (89.67%), Logistic Regression (88.37%), Random Forest (87.84%), and Naïve Bayes (81.27%). The integrated Telegram chatbot successfully provided automated initial guidance and submitted categorized tickets to the existing service desk platform. Novelty: While many reviewed higher education chatbots focus on FAQ retrieval or intent recognition, this study establishes an end-to-end framework integrating deep learning contextual text classification with an open-source conversational agent and a web-based IT helpdesk system, supporting automated ticket categorization and submission for academic IT service management.

Kata kunci

Jaringan kolaborasi para penulis

28 penulis · 77 tautan kepenulisan bersama · 47 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Telkom University
  • Politeknik Negeri Medan
  • Universitas Sumatera Utara
  • Universitas Muhammadiyah Sumatera Utara
  • International Islamic University Malaysia
  • National Research and Innovation Agency
  • Pertamina (Indonesia)
  • Organisasi lain
  • Afiliasi tidak diketahui
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Arif Ridho LubisPoliteknik Negeri Medan8
Al-Khowarizmi Al-KhowarizmiUniversitas Muhammadiyah Sumatera Utara7
Romi Fadillah RahmatUniversitas Sumatera Utara3
Julham JulhamPoliteknik Negeri Medan2
Tien Fabrianti KusumasariTelkom University1
Lukmanul HakimInternational Islamic University Malaysia1
Hanif FakhrurrojaNational Research and Innovation Agency1
Rian Bimo AnkhalTelkom University1
Muhammad Fakhrul SafitraPertamina (Indonesia)1
Sinung SuakantoTelkom University1
Jan M. PawlowskiAfiliasi tidak diketahui1
Litasari Widyastuti SuwarsonoTelkom University1
Joko SiswantoBandung Institute of Technology1
Syfa Nur LathifahTelkom University1
Idham KamilPoliteknik Negeri Medan1
Dini Oktarina Dwi HandayaniTaylor's University1
Sarah PurnamawatiUniversitas Sumatera Utara1
Mhd Faris PratamaUniversitas Sumatera Utara1
Sharfina FazaPoliteknik Negeri Medan1
Irvan IrvanUniversitas Muhammadiyah Sumatera Utara1
Habibi Ramdani SafitriPoliteknik Negeri Medan1
Ilham Ramadhan NasutionMedan Area University1
Adityas WidjajartoTelkom University1
Deden WitarsyahTelkom University1
Hafid Rahman HarefaPoliteknik Negeri Medan1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) https://journal.unnes.ac.id/journals/sji/oai, pertama di-harvest 6 Nov 2026, terakhir terlihat 8 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en">Integrating Fine-Tuned IndoBERT into a Conversational Chatbot for Automated Ticket Categorization</dc:title>
	<dc:creator xml:lang="en">Ferdinand, Yulio</dc:creator>
	<dc:creator xml:lang="en">Lubis, Muharman</dc:creator>
	<dc:creator xml:lang="en">Pratiwi, Oktariani Nurul </dc:creator>
	<dc:subject xml:lang="en">IndoBERT</dc:subject>
	<dc:subject xml:lang="en">IT service desk</dc:subject>
	<dc:subject xml:lang="en">NLP</dc:subject>
	<dc:subject xml:lang="en">Ticket categorization</dc:subject>
	<dc:subject xml:lang="en">Chatbot</dc:subject>
	<dc:description xml:lang="en">Purpose: University IT service desks frequently face operational bottlenecks due to manual ticket classification and high incident volumes. This study aims to develop an automated ticket categorization workflow by fine-tuning the IndoBERT model and embedding it into an interactive chatbot for real-time ticket categorization.
Methods: A dataset of 6,192 Indonesian-language service desk tickets was divided into training (70%), validation (15%), and test (15%) sets. Class-weighted training was applied to address class imbalance, while grid search was performed to optimize the learning rate, batch size, and number of training epochs. The optimal model was then integrated into the Rasa conversational framework via custom actions and connected to the existing web-based service desk through a REST API, with Telegram serving as the user interface.
Result: Fine-tuned IndoBERT achieved a test accuracy of 92.03% and a macro- and weighted-average F1-score of approximately 0.92, outperforming SVM (89.67%), Logistic Regression (88.37%), Random Forest (87.84%), and Naïve Bayes (81.27%). The integrated Telegram chatbot successfully provided automated initial guidance and submitted categorized tickets to the existing service desk platform.
Novelty: While many reviewed higher education chatbots focus on FAQ retrieval or intent recognition, this study establishes an end-to-end framework integrating deep learning contextual text classification with an open-source conversational agent and a web-based IT helpdesk system, supporting automated ticket categorization and submission for academic IT service management.</dc:description>
	<dc:publisher xml:lang="en">Universitas Negeri Semarang</dc:publisher>
	<dc:date>2026-11-03</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en">Peer-reviewed Article</dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://journal.unnes.ac.id/journals/sji/article/view/63341</dc:identifier>
	<dc:identifier>10.15294/sji.v13i4.63341</dc:identifier>
	<dc:source xml:lang="en">Scientific Journal of Informatics; Vol. 13 No. 4: Regular Issue; 875-884</dc:source>
	<dc:source>2407-7658</dc:source>
	<dc:source>2460-0040</dc:source>
	<dc:source>10.15294/sji.v13i4</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://journal.unnes.ac.id/journals/sji/article/view/63341/12129</dc:relation>
	<dc:rights xml:lang="en">Copyright (c) 2026 Scientific Journal of Informatics</dc:rights>
</oai_dc:dc>