Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Javanese part-of-speech tagging using cross-lingual transfer learning

IAES International Journal of Artificial Intelligence · Vol. 13 No. 3 (2024) · hlm. 3498–3509

DOI
10.11591/ijai.v13.i3.pp3498-3509
ISSN
2252-8938, 2089-4872
Terbit
2024-09-01
Penerbit
Institute of Advanced Engineering and Science
Bahasa
eng
Lisensi
creativecommons.org/licenses/by-sa/4.0

Abstrak

Large datasets that are publicly available for POS tagging do not always exist for some languages. One of those languages is Javanese, a local language in Indonesia, which is considered as a low-resource language. This research aims to examine the effectiveness of cross-lingual transfer learning for Javanese POS tagging by fine-tuning the state-of-the-art Transformer-based models (such as IndoBERT, mBERT, and XLM-RoBERTa) using different kinds of source languages that have a higher resource (such as Indonesian, English, Uyghur, Latin, and Hungarian languages), and then fine-tuning it again using the Javanese language as the target language. We found that the models using cross-lingual transfer learning can increase the accuracy of the models without using cross-lingual transfer learning by 14.3%–15.3% over LSTM-based models, and by 0.21%–3.95% over Transformer-based models. Our results show that the most accurate Javanese POS tagger model is XLM-RoBERTa that is fine-tuned in two stages (the first one using Indonesian language as the source language, and the second one using Javanese language as the target language), capable of achieving an accuracy of 87.65%

Kata kunci

Jaringan kolaborasi para penulis

16 penulis · 28 tautan kepenulisan bersama · 9 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • University of Indonesia
  • Institut Teknologi Bacharuddin Jusuf Habibie
  • Taylor's University
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Meganingrum Arista JiwanggiUniversity of Indonesia2
Nuzulul Khairu NissaUniversity of Indonesia2
Jatmiko Budi BaskoroUniversity of Indonesia1
Emmanuella Anggi SiallaganUniversity of Indonesia1
Muhammad Rizki SyazaliUniversity of Indonesia1
Nicholas PangestuUniversity of Indonesia1
Naradhipa BharyUniversity of Indonesia1
Jafar AbdurrohmanUniversity of Indonesia1
Fariz Wahyuzan DwitilasUniversity of Indonesia1
Eka Qadri NurantiInstitut Teknologi Bacharuddin Jusuf Habibie1
Husna Sarirah HusinTaylor's University1
Piawai Said UmbaraUniversity of Indonesia1
Putri RizqiyahUniversity of Indonesia1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) http://ijai.iaescore.com/index.php/IJAI/oai, pertama di-harvest 8 Nov 2026, terakhir terlihat 16 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Javanese part-of-speech tagging using cross-lingual transfer learning</dc:title>
	<dc:creator>Enrique, Gabriel</dc:creator>
	<dc:creator>Alfina, Ika</dc:creator>
	<dc:creator>Yulianti, Evi</dc:creator>
	<dc:subject xml:lang="en-US">Part-of-speech tagging; Natural Language Processing;</dc:subject>
	<dc:subject xml:lang="en-US">Cross-lingual transfer learning; Deep learning; Low-resource language; Part-of-speech tagging; Transformer</dc:subject>
	<dc:description xml:lang="en-US">Large datasets that are publicly available for POS tagging do not always exist for some languages. One of those languages is Javanese, a local language in Indonesia, which is considered as a low-resource language. This research aims to examine the effectiveness of cross-lingual transfer learning for Javanese POS tagging by fine-tuning the state-of-the-art Transformer-based models (such as IndoBERT, mBERT, and XLM-RoBERTa) using different kinds of source languages that have a higher resource (such as Indonesian, English, Uyghur, Latin, and Hungarian languages), and then fine-tuning it again using the Javanese language as the target language. We found that the models using cross-lingual transfer learning can increase the accuracy of the models without using cross-lingual transfer learning by 14.3%–15.3% over LSTM-based models, and by 0.21%–3.95% over Transformer-based models. Our results show that the most accurate Javanese POS tagger model is XLM-RoBERTa that is fine-tuned in two stages (the first one using Indonesian language as the source language, and the second one using Javanese language as the target language), capable of achieving an accuracy of 87.65%</dc:description>
	<dc:publisher xml:lang="en-US">Institute of Advanced Engineering and Science</dc:publisher>
	<dc:contributor xml:lang="en-US">Directorate of Research and Development, Universitas Indonesia</dc:contributor>
	<dc:date>2024-09-01</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US"></dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://ijai.iaescore.com/index.php/IJAI/article/view/24615</dc:identifier>
	<dc:identifier>10.11591/ijai.v13.i3.pp3498-3509</dc:identifier>
	<dc:source xml:lang="en-US">IAES International Journal of Artificial Intelligence (IJ-AI); Vol 13, No 3: September 2024; 3498-3509</dc:source>
	<dc:source>2252-8938</dc:source>
	<dc:source>2089-4872</dc:source>
	<dc:source>10.11591/ijai.v13.i3</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://ijai.iaescore.com/index.php/IJAI/article/view/24615/14162</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2024 Institute of Advanced Engineering and Science</dc:rights>
	<dc:rights xml:lang="en-US">http://creativecommons.org/licenses/by-sa/4.0</dc:rights>
</oai_dc:dc>