Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Text clustering for analyzing scientific article using pre-trained language model and k-means algorithm

Bulletin of Electrical Engineering and Informatics · Vol. 14 No. 5 (2025) · hlm. 3728–3740

DOI
10.11591/eei.v14i5.9670
ISSN
2089-3191, 2302-9285
Terbit
2025-10-01
Penerbit
Institute of Advanced Engineering and Science (IAES)
Bahasa
en
Lisensi
creativecommons.org/licenses/by-sa/4.0/

Abstrak

Text clustering is a technique in data mining that can be used for analyzing scientific articles. In Indonesia-accredited journals, SINTA, there are two languages used, Indonesian and English. This is the first research focusing on clustering Indonesian and English texts into one cluster. In this research, bidirectional encoder representations from transformers (BERT) and IndoBERT are used to represent text data into fixed feature vectors. BERT and IndoBERT are pre-trained language models (PLMs) that can produce vector representations that take care of the position and context in a sentence. To cluster the articles, the K-Means algorithm is implemented. This algorithm has good convergence and adapts to the new examples, which helps in improved clustering performance. The best k-value in the K-Means algorithm is defined by using the silhouette score, the elbow method, and the Davies-Bouldin index (DBI). The experiment shows that the silhouette score can produce the most optimal k-value in clustering the articles, which has a mean score of 0.597. The mean score for the elbow method is 0.425, and for the DBI is 0.412. Therefore, the silhouette score optimizes the performance of PLMs and the K-Means algorithm in analyzing scientific articles to determine whether in scope or out of scope.

Kata kunci

Jaringan kolaborasi para penulis

40 penulis · 166 tautan kepenulisan bersama · 29 lintas organisasi · menampilkan 40 yang paling banyak terhubung

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Sriwijaya University
  • Politeknik Negeri Sriwijaya
  • Bandung Institute of Technology
  • Universitas Bina Darma
  • Lampung University
  • Indonesia University of Education
  • Telkom University
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Ade Iriani SapitriSriwijaya University30
Bambang TutukoSriwijaya University27
Anggun IslamiSriwijaya University16
Sukemi SukemiSriwijaya University8
Akhiar Wista ArumSriwijaya University7
Dian Palupi RiniSriwijaya University7
Jordan MarcelinoSriwijaya University7
Rendy IsdwantaSriwijaya University7
Samsuryadi SamsuryadiSriwijaya University6
Hadi SyaputraSriwijaya University4
Muhammad Taufik RosenoSriwijaya University4
Winda Kurnia SariSriwijaya University3
Nyayu Latifah HusniBandung Institute of Technology2
Irsyadi YaniSriwijaya University2
Ade SilviaBandung Institute of Technology2
Bhakti Yudho SupraptoSriwijaya University2
Radiyati Umi PartanSriwijaya University2
Ayu PurwariantiBandung Institute of Technology1
Mardiana MardianaLampung University1
Saparudin SaparudinSriwijaya University1
Erwin ErwinSriwijaya University1
Clara Fin BadillahSriwijaya University1
Junia ErlinaSriwijaya University1
Auzan LazuardiSriwijaya University1
Tresna DewiPoliteknik Negeri Sriwijaya1
Pola RismaPoliteknik Negeri Sriwijaya1
Yurni OktarinaPoliteknik Negeri Sriwijaya1
Muhammad RorizPoliteknik Negeri Sriwijaya1
Ari WidodoIndonesia University of Education1
Yenny AnwarSriwijaya University1
Zaky Al fatihTelkom University1
Diah KartikaSriwijaya University1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OpenAlex API (jurnal SINTA, ADR 0048) https://openalex.org/S2765016208, pertama di-harvest 19 Nov 2026, terakhir terlihat 19 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/"><dc:title xml:lang="en">Text clustering for analyzing scientific article using pre-trained language model and k-means algorithm</dc:title><dc:creator>Firdaus Firdaus</dc:creator><dc:creator>Siti Nurmaini</dc:creator><dc:creator>Novi Yusliani</dc:creator><dc:creator>Muhammad Naufal Rachmatullah</dc:creator><dc:creator>Annisa Darmawahyuni</dc:creator><dc:creator>Yesi Novaria Kunang</dc:creator><dc:creator>Muhammad Fachrurrozi</dc:creator><dc:creator>Risky Armansyah</dc:creator><dc:subject>document clustering</dc:subject><dc:subject>scientific articles</dc:subject><dc:subject>pre-trained language models</dc:subject><dc:subject>BERT</dc:subject><dc:subject>IndoBERT</dc:subject><dc:subject>K-means clustering</dc:subject><dc:subject>silhouette coefficient</dc:subject><dc:subject>elbow method</dc:subject><dc:subject>Davies-Bouldin index</dc:subject><dc:subject>optimal number of clusters</dc:subject><dc:description xml:lang="en">Text clustering is a technique in data mining that can be used for analyzing scientific articles. In Indonesia-accredited journals, SINTA, there are two languages used, Indonesian and English. This is the first research focusing on clustering Indonesian and English texts into one cluster. In this research, bidirectional encoder representations from transformers (BERT) and IndoBERT are used to represent text data into fixed feature vectors. BERT and IndoBERT are pre-trained language models (PLMs) that can produce vector representations that take care of the position and context in a sentence. To cluster the articles, the K-Means algorithm is implemented. This algorithm has good convergence and adapts to the new examples, which helps in improved clustering performance. The best k-value in the K-Means algorithm is defined by using the silhouette score, the elbow method, and the Davies-Bouldin index (DBI). The experiment shows that the silhouette score can produce the most optimal k-value in clustering the articles, which has a mean score of 0.597. The mean score for the elbow method is 0.425, and for the DBI is 0.412. Therefore, the silhouette score optimizes the performance of PLMs and the K-Means algorithm in analyzing scientific articles to determine whether in scope or out of scope.</dc:description><dc:publisher>Institute of Advanced Engineering and Science (IAES)</dc:publisher><dc:date>2025-10-01</dc:date><dc:type>info:eu-repo/semantics/article</dc:type><dc:format>application/pdf</dc:format><dc:identifier>https://doi.org/10.11591/eei.v14i5.9670</dc:identifier><dc:identifier>10.11591/eei.v14i5.9670</dc:identifier><dc:source>Bulletin of Electrical Engineering and Informatics; Vol 14 No 5 (2025); 3728-3740</dc:source><dc:source>2089-3191</dc:source><dc:source>2302-9285</dc:source><dc:language>en</dc:language><dc:relation>https://beei.org/index.php/EEI/article/download/9670/4389</dc:relation><dc:rights>https://creativecommons.org/licenses/by-sa/4.0/</dc:rights></oai_dc:dc>