Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Impact of smoothing techniques for text classification: implementation in hidden Markov model

IAES International Journal of Artificial Intelligence · Vol. 14 No. 6 (2025) · hlm. 5183–5192

DOI
10.11591/ijai.v14.i6.pp5183-5192
ISSN
2252-8938, 2089-4872
Terbit
2025-12-01
Penerbit
Institute of Advanced Engineering and Science
Bahasa
eng
Lisensi
creativecommons.org/licenses/by-sa/4.0

Abstrak

A hidden Markov model (HMM) is widely used for sequence modeling in various text classification tasks. This study investigates the impact of different smoothing techniques, such as Laplace, absolute discounting, and Gibbs sampling on HMM performance across three distinct domains: e-commerce products, spam filtering, and occupational data mining. Through the comparative analysis, Laplace smoothing consistently outperforms other techniques in handling zero-probability issues, demonstrating superior performance in the e-commerce and SMS spam datasets. The HMM without any smoothing technique achieved the best results for job title classification. This divergence underscores the dataset-specific nature of smoothing requirements, where the simplicity of parameter estimation proves effective in contexts characterized by a limited and repetitive vocabulary. Hence, the findings suggest that tailored smoothing strategies are crucial for optimizing HMM performance in different textual analysis applications.

Kata kunci

Jaringan kolaborasi para penulis

30 penulis · 84 tautan kepenulisan bersama · 18 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Universiti Teknologi MARA
  • HELP University
  • Sultan Zainal Abidin University
  • State University of Semarang
  • Universiti Malaysia Pahang Al-Sultan Abdullah
  • Afiliasi tidak diketahui
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Shafaf IbrahimUniversiti Teknologi MARA3
Saadi Bin Ahmad KamaruddinHELP University3
Hazrita Ab RahimHELP University2
Umi Marshida Abd HamidUniversiti Teknologi MARA2
Budi SunarkoState University of Semarang1
Nur Afiqah Mohd FuadUniversiti Teknologi MARA1
Raihah AminuddinUniversiti Teknologi MARA1
Ismail MusirinUniversiti Teknologi MARA1
Azlee ZabidiUniversiti Malaysia Pahang Al-Sultan Abdullah1
Marina YusoffUniversiti Teknologi MARA1
Siti Sarah Md NohUniversiti Teknologi MARA1
Nurain IbrahimUniversiti Teknologi MARA1
Mahayaudin M. MansorAfiliasi tidak diketahui1
Ismail MusirinUniversiti Teknologi MARA1
Ahmad Taufek Abdul RahmanUniversiti Teknologi MARA1
Mohd Hafiz Hanafiah‬Universiti Teknologi MARA1
Nur Adilah Md ZainUniversiti Teknologi MARA1
Caroline HenryUniversiti Teknologi MARA1
Ahmad Naqiyuddin BakarUniversiti Teknologi MARA1
Lay Kek TehUniversiti Teknologi MARA1
Salfarina RamliUniversiti Teknologi MARA1
Nor Suhaila Rosmimi RosliUniversiti Teknologi MARA1
Rohana AhmadUniversiti Teknologi MARA1
Mohd Zaki SallehUniversiti Teknologi MARA1
Sahol Hamid Abu BakarUniversiti Teknologi MARA1
Richard Johari JamesUniversiti Teknologi MARA1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) http://ijai.iaescore.com/index.php/IJAI/oai, pertama di-harvest 8 Nov 2026, terakhir terlihat 16 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Impact of smoothing techniques for text classification: implementation in hidden Markov model</dc:title>
	<dc:creator>Mathivanan, Norsyela Muhammad Noor</dc:creator>
	<dc:creator>Mohd Janor, Roziah</dc:creator>
	<dc:creator>Abd Razak, Shukor</dc:creator>
	<dc:creator>Md. Ghani, Nor Azura</dc:creator>
	<dc:subject xml:lang="en-US"></dc:subject>
	<dc:subject xml:lang="en-US">E-commerce products; Job title classification; Occupational data mining; Product classification; Sequential data; Spam filtering; Supervised learning model</dc:subject>
	<dc:description xml:lang="en-US">A hidden Markov model (HMM) is widely used for sequence modeling in various text classification tasks. This study investigates the impact of different smoothing techniques, such as Laplace, absolute discounting, and Gibbs sampling on HMM performance across three distinct domains: e-commerce products, spam filtering, and occupational data mining. Through the comparative analysis, Laplace smoothing consistently outperforms other techniques in handling zero-probability issues, demonstrating superior performance in the e-commerce and SMS spam datasets. The HMM without any smoothing technique achieved the best results for job title classification. This divergence underscores the dataset-specific nature of smoothing requirements, where the simplicity of parameter estimation proves effective in contexts characterized by a limited and repetitive vocabulary. Hence, the findings suggest that tailored smoothing strategies are crucial for optimizing HMM performance in different textual analysis applications.</dc:description>
	<dc:publisher xml:lang="en-US">Institute of Advanced Engineering and Science</dc:publisher>
	<dc:contributor xml:lang="en-US"></dc:contributor>
	<dc:date>2025-12-01</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US"></dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://ijai.iaescore.com/index.php/IJAI/article/view/27033</dc:identifier>
	<dc:identifier>10.11591/ijai.v14.i6.pp5183-5192</dc:identifier>
	<dc:source xml:lang="en-US">IAES International Journal of Artificial Intelligence (IJ-AI); Vol 14, No 6: December 2025; 5183-5192</dc:source>
	<dc:source>2252-8938</dc:source>
	<dc:source>2089-4872</dc:source>
	<dc:source>10.11591/ijai.v14.i6</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://ijai.iaescore.com/index.php/IJAI/article/view/27033/14891</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2025 Norsyela Muhammad Noor Mathivanan, Roziah Mohd Janor, Shukor Abd Razak, Nor Azura Md.Ghani</dc:rights>
	<dc:rights xml:lang="en-US">http://creativecommons.org/licenses/by-sa/4.0</dc:rights>
</oai_dc:dc>