Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Multi-task Learning for Named Entity Recognition and Intent Classification in Natural Language Understanding Applications

Journal of Information Systems Engineering and Business Intelligence · Vol. 11 No. 1 (2025) · hlm. 1–16

DOI
10.20473/jisebi.11.1.1-16
ISSN
2443-2555, 2598-6333
Terbit
2025-03-28
Penerbit
Universitas Airlangga
Bahasa
eng
Lisensi
creativecommons.org/licenses/by/4.0

Abstrak

Background: Understanding human language is a part of the research in Natural Language Processing (NLP) known as Natural Language Understanding (NLU). It becomes a crucial part of some NLP applications such as chatbots, that interpret the user intent and important entities. NLU systems depend on intent classification and named entity recognition (NER) which is crucial for understanding the user input to extract meaningful information. Not only important in chatbots, NLU also provides a pivotal function in other applications for efficient and precise text understanding. Objective: The aim of this study is to introduce multitask learning techniques to improve the application's performance on NLU tasks, especially intent classification and NER in specific domains. Methods: To achieve the language understanding capability, a strategy is to combine the intent classification and entity recognition tasks by using a shared model based on the shared representation and task dependencies. This approach is known as multitask learning and leverages the collaborative interaction between these related tasks to enhance performance. The proposed learning architecture is designed to be adaptable to various NLU-based applications, but in this work are discussed use cases in chatbots. Results: The results show the effectiveness of the proposed approach by following several experiments, both from intent classification and named entity recognitions. The multitask learning capabilities highlight the potential of multi-task learning in chatbot systems for close domains. The optimal hyperparameters consist of a warm-up step of 60, an early stopping probability of 10, a weight decay of 0.001, a Named Entity Recognition (NER) loss weight of 0.58, and an intention classification loss weight of 0.4. Conclusion: The performance of Dual Intent and Entity Transformer (DIET) for both tasks—intent classification and named entity recognition—is highly dependent on the data. This leads to various capabilities for the hyperparameter combinations. Our proposed model architecture significantly outperforms previous studies based on common evaluation metrics. Keywords: Natural Language Understanding, Chatbot, Multi-task Learning, Named Entity Recognition

Jaringan kolaborasi para penulis

40 penulis · 83 tautan kepenulisan bersama · 9 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • University of Brawijaya
  • Institut Teknologi Sepuluh Nopember
  • State University of Semarang
  • Afiliasi tidak diketahui
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Sigit AdinugrohoUniversity of Brawijaya3
Budi Darma SetiawanUniversity of Brawijaya2
Zahra Asma AnnisaUniversity of Brawijaya2
Faiz Aulia Al FarisiUniversity of Brawijaya2
Tri Hadiah MuliawatiInstitut Teknologi Sepuluh Nopember1
Reddy AlexandroInstitut Teknologi Sepuluh Nopember1
Fitra Abdurrachman BachtiarUniversity of Brawijaya1
Nathanael Victor DarenohUniversity of Brawijaya1
Chastine FatichahInstitut Teknologi Sepuluh Nopember1
Diana PurwitasariInstitut Teknologi Sepuluh Nopember1
Muh. Arif RahmanUniversity of Brawijaya1
Edy SantosaUniversity of Brawijaya1
Satrio Agung WicaksonoUniversity of Brawijaya1
Rochmat SetiyawanUniversity of Brawijaya1
Budi Darma SetiyawanUniversity of Brawijaya1
Ari HernawanUniversity of Brawijaya1
Wayan Firdaus MahmudyUniversity of Brawijaya1
Ghenniy RachmansyahUniversity of Brawijaya1
Yuita Arum SariUniversity of Brawijaya1
Randy Cahya WihandikaUniversity of Brawijaya1
Yurdha Fadhila HernawanUniversity of Brawijaya1
Naziha AzharUniversity of Brawijaya1
Ilham FirmansyahUniversity of Brawijaya1
Indriati .Afiliasi tidak diketahui1
Anshar ZulhilmiUniversity of Brawijaya1
Muhammad Fathur Rahman KhairulUniversity of Brawijaya1
Aryo PinanditoUniversity of Brawijaya1
Multohadi HamzaturrazakUniversity of Brawijaya1
Abdul JabbarState University of Semarang1
Firman AfrialdyAfiliasi tidak diketahui1
Firman AfrialdyAfiliasi tidak diketahui1
Candra DewiAfiliasi tidak diketahui1
Candra DewiState University of Semarang1
Rafi Indra FattahAfiliasi tidak diketahui1
Rafi Indra FattahAfiliasi tidak diketahui1
Eriq Muhammad Adams JonemaroUniversity of Brawijaya1
Arceilo HanantaAfiliasi tidak diketahui1
Muhammad Rizki ArziAfiliasi tidak diketahui1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) https://e-journal.unair.ac.id/JISEBI/oai, pertama di-harvest 29 Okt 2026, terakhir terlihat 15 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Multi-task Learning for Named Entity Recognition and Intent Classification in Natural Language Understanding Applications</dc:title>
	<dc:creator>Perdana, Rizal Setya</dc:creator>
	<dc:creator>Adikara, Putra Pandu</dc:creator>
	<dc:description xml:lang="en-US">Background: Understanding human language is a part of the research in Natural Language Processing (NLP) known as Natural Language Understanding (NLU). It becomes a crucial part of some NLP applications such as chatbots, that interpret the user intent and important entities. NLU systems depend on intent classification and named entity recognition (NER) which is crucial for understanding the user input to extract meaningful information. Not only important in chatbots, NLU also provides a pivotal function in other applications for efficient and precise text understanding.
Objective: The aim of this study is to introduce multitask learning techniques to improve the application's performance on NLU tasks, especially intent classification and NER in specific domains.
Methods: To achieve the language understanding capability, a strategy is to combine the intent classification and entity recognition tasks by using a shared model based on the shared representation and task dependencies. This approach is known as multitask learning and leverages the collaborative interaction between these related tasks to enhance performance. The proposed learning architecture is designed to be adaptable to various NLU-based applications, but in this work are discussed use cases in chatbots.
Results: The results show the effectiveness of the proposed approach by following several experiments, both from intent classification and named entity recognitions. The multitask learning capabilities highlight the potential of multi-task learning in chatbot systems for close domains. The optimal hyperparameters consist of a warm-up step of 60, an early stopping probability of 10, a weight decay of 0.001, a Named Entity Recognition (NER) loss weight of 0.58, and an intention classification loss weight of 0.4.
Conclusion: The performance of Dual Intent and Entity Transformer (DIET) for both tasks—intent classification and named entity recognition—is highly dependent on the data. This leads to various capabilities for the hyperparameter combinations. Our proposed model architecture significantly outperforms previous studies based on common evaluation metrics.
Keywords: Natural Language Understanding, Chatbot, Multi-task Learning, Named Entity Recognition</dc:description>
	<dc:publisher xml:lang="en-US">Universitas Airlangga</dc:publisher>
	<dc:date>2025-03-28</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:format>text/xml</dc:format>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://e-journal.unair.ac.id/JISEBI/article/view/56303</dc:identifier>
	<dc:identifier>10.20473/jisebi.11.1.1-16</dc:identifier>
	<dc:source xml:lang="en-US">Journal of Information Systems Engineering and Business Intelligence; Vol. 11 No. 1 (2025): February; 1-16</dc:source>
	<dc:source>2443-2555</dc:source>
	<dc:source>2598-6333</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://e-journal.unair.ac.id/JISEBI/article/view/56303/33658</dc:relation>
	<dc:relation>https://e-journal.unair.ac.id/JISEBI/article/view/56303/32184</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2025 The Authors. Published by Universitas Airlangga.</dc:rights>
	<dc:rights xml:lang="en-US">http://creativecommons.org/licenses/by/4.0</dc:rights>
</oai_dc:dc>