Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Effective preprocessing based neural machine translation for English to Telugu cross-language information retrieval

IAES International Journal of Artificial Intelligence · Vol. 10 No. 2 (2021) · hlm. 306–315

DOI
10.11591/ijai.v10.i2.pp306-315
ISSN
2252-8938, 2089-4872
Terbit
2021-06-01
Penerbit
Institute of Advanced Engineering and Science
Bahasa
eng
Lisensi
creativecommons.org/licenses/by-sa/4.0

Abstrak

In cross-language information retrieval (CLIR), the neural machine translation (NMT) plays a vital role. CLIR retrieves the information written in a language which is different from the user's query language. In CLIR, the main concern is to translate the user query from the source language to the target language. NMT is useful for translating the data from one language to another. NMT has better accuracy for different languages like English to German and so-on. In this paper, NMT has applied for translating English to Indian languages, especially for Telugu. Besides NMT, an effort is also made to improve accuracy by applying effective preprocessing mechanism. The role of effective preprocessing in improving accuracy will be less but countable. Machine translation (MT) is a data-driven approach where parallel corpus will act as input in MT. NMT requires a massive amount of parallel corpus for performing the translation. Building an English - Telugu parallel corpus is costly because they are resource-poor languages. Different mechanisms are available for preparing the parallel corpus. The major issue in preparing parallel corpus is data replication that is handled during preprocessing. The other issue in machine translation is the out-of-vocabulary (OOV) problem. Earlier dictionaries are used to handle OOV problems. To overcome this problem the rare words are segmented into sequences of subwords during preprocessing. The parameters like accuracy, perplexity, cross-entropy and BLEU scores shows better translation quality for NMT with effective preprocessing.

Kata kunci

Jaringan kolaborasi para penulis

20 penulis · 53 tautan kepenulisan bersama · 22 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • SRKR Engineering College
  • Narasaraopeta Engineering College
  • Koneru Lakshmaiah Education Foundation
  • NEC (Japan)
  • Krishna University
  • Vallurupalli Nageswara Rao Vignana Jyothi Institute of Engineering and Technology
  • Afiliasi tidak diketahui
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Poonam GuptaAfiliasi tidak diketahui2
Dipan ShahAfiliasi tidak diketahui2
Khyati R. NirmalAfiliasi tidak diketahui2
Y. Leela Sandhya RaniKoneru Lakshmaiah Education Foundation1
V. SucharitaNEC (Japan)1
Salma SyedNarasaraopeta Engineering College1
Nadimpalli Usha Deepa SundariNarasaraopeta Engineering College1
Satish Babu DogipartiNarasaraopeta Engineering College1
Duggimpudi Mary Sharmila RaniAfiliasi tidak diketahui1
Ankireddy YenireddyNarasaraopeta Engineering College1
N. KumarAfiliasi tidak diketahui1
Rajeev SunkaraKrishna University1
Buddaraju RevathiKoneru Lakshmaiah Education Foundation1
Ajay Dilip Kumar MarapatlaVallurupalli Nageswara Rao Vignana Jyothi Institute of Engineering and Technology1
Kagitha VeeramanikantaSRKR Engineering College1
Katta DineshSRKR Engineering College1
Maddirala SuprajaSRKR Engineering College1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) http://ijai.iaescore.com/index.php/IJAI/oai, pertama di-harvest 8 Nov 2026, terakhir terlihat 16 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Effective preprocessing based neural machine translation for English to Telugu cross-language information retrieval</dc:title>
	<dc:creator>Raju, B. N. V. Narasimha</dc:creator>
	<dc:creator>Raju, M. S. V. S. Bhadri</dc:creator>
	<dc:creator>V. Satyanarayana, K. V.</dc:creator>
	<dc:subject xml:lang="en-US"></dc:subject>
	<dc:subject xml:lang="en-US">Cross-language IR; Long short-term memory; Machine translation; Neural machine translation; Preprocessing</dc:subject>
	<dc:description xml:lang="en-US">In cross-language information retrieval (CLIR), the neural machine translation (NMT) plays a vital role. CLIR retrieves the information written in a language which is different from the user's query language. In CLIR, the main concern is to translate the user query from the source language to the target language. NMT is useful for translating the data from one language to another. NMT has better accuracy for different languages like English to German and so-on. In this paper, NMT has applied for translating English to Indian languages, especially for Telugu. Besides NMT, an effort is also made to improve accuracy by applying effective preprocessing mechanism. The role of effective preprocessing in improving accuracy will be less but countable. Machine translation (MT) is a data-driven approach where parallel corpus will act as input in MT. NMT requires a massive amount of parallel corpus for performing the translation. Building an English - Telugu parallel corpus is costly because they are resource-poor languages. Different mechanisms are available for preparing the parallel corpus. The major issue in preparing parallel corpus is data replication that is handled during preprocessing. The other issue in machine translation is the out-of-vocabulary (OOV) problem. Earlier dictionaries are used to handle OOV problems. To overcome this problem the rare words are segmented into sequences of subwords during preprocessing. The parameters like accuracy, perplexity, cross-entropy and BLEU scores shows better translation quality for NMT with effective preprocessing.</dc:description>
	<dc:publisher xml:lang="en-US">Institute of Advanced Engineering and Science</dc:publisher>
	<dc:contributor xml:lang="en-US"></dc:contributor>
	<dc:date>2021-06-01</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US"></dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://ijai.iaescore.com/index.php/IJAI/article/view/20837</dc:identifier>
	<dc:identifier>10.11591/ijai.v10.i2.pp306-315</dc:identifier>
	<dc:source xml:lang="en-US">IAES International Journal of Artificial Intelligence (IJ-AI); Vol 10, No 2: June 2021; 306-315</dc:source>
	<dc:source>2252-8938</dc:source>
	<dc:source>2089-4872</dc:source>
	<dc:source>10.11591/ijai.v10.i2</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://ijai.iaescore.com/index.php/IJAI/article/view/20837/13117</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2021 Institute of Advanced Engineering and Science</dc:rights>
	<dc:rights xml:lang="en-US">http://creativecommons.org/licenses/by-sa/4.0</dc:rights>
</oai_dc:dc>