Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Available techniques in hadoop small file issue

International Journal of Electrical and Computer Engineering (IJECE) · Vol. 10 No. 2 (2020)

DOI
10.11591/ijece.v10i2.pp2097-2101
ISSN
2088-8708, 2088-8708
Terbit
2020-04-01
Penerbit
Institute of Advanced Engineering and Science
Lisensi
creativecommons.org/licenses/by-nc/4.0

Abstrak

Hadoop is an optimal solution for big data processing and storing since being released in the late of 2006, hadoop data processing stands on master-slaves manner [1] that’s splits the large file job into several small files in order to process them separately, this technique was adopted instead of pushing one large file into a costly super machine to insights some useful information. Hadoop runs very good with large file of big data, but when it comes to big data in small files it could facing some problems in performance, processing slow down, data access delay, high latency and up to a completely cluster shutting down [2]. In this paper we will high light on one of hadoop’s limitations, that’s affects the data processing performance, one of these limits called “big data in small files” accrued when a massive number of small files pushed into a hadoop cluster which will rides the cluster to shut down totally. This paper also high light on some native and proposed solutions for big data in small files, how do they work to reduce the negative effects on hadoop cluster, and add extra performance on storing and accessing mechanism.

Jaringan kolaborasi para penulis

13 penulis · 24 tautan kepenulisan bersama · 8 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Universiti Teknikal Malaysia Melaka
  • Institut Teknologi PLN
  • Universiti Teknologi MARA
  • Afiliasi tidak diketahui
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Mohad Sanusi AzmiAfiliasi tidak diketahui2
Ahmed Abdalla SheikhUniversiti Teknikal Malaysia Melaka1
Waleed Abdel Karim AbuainAfiliasi tidak diketahui1
Maslita Abd AzizUniversiti Teknikal Malaysia Melaka1
Dine Tiara KusumaInstitut Teknologi PLN1
Norashikin AhmadUniversiti Teknikal Malaysia Melaka1
Iriansyah Bm SangadjiInstitut Teknologi PLN1
Yozika ArvioInstitut Teknologi PLN1
Zuleaizal SidekUniversiti Teknikal Malaysia Melaka1
Noor Hasimah Ibrahim TeoUniversiti Teknologi MARA1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Data ini berasal dari Crossref (yang disetorkan penerbit), karena endpoint OAI-PMH milik jurnal tidak dapat di-harvest.

Sumber metadata: Crossref API (cadangan, berdasarkan ISSN) https://api.crossref.org/journals/2088-8708/works, pertama di-harvest 27 Okt 2026, terakhir terlihat 15 Nov 2026.
Metadata sebagai oai_dc, dikonversi dari Crossref
<oai_dc:dc xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/"><dc:title>Available techniques in hadoop small file issue</dc:title><dc:creator>Masadeh, M. B.</dc:creator><dc:creator>Azmi, M. S.</dc:creator><dc:creator>Ahmad, S. S. S.</dc:creator><dc:description>&lt;jats:p&gt;Hadoop is an optimal solution for big data processing and storing since being released in the late of 2006, hadoop data processing stands on master-slaves manner [1] that’s splits the large file job into several small files in order to process them separately, this technique was adopted instead of pushing one large file into a costly super machine to insights some useful information. Hadoop runs very good with large file of big data, but when it comes to big data in small files it could facing some problems in performance, processing slow down, data access delay, high latency and up to a completely cluster shutting down [2]. In this paper we will high light on one of hadoop’s limitations, that’s affects the data processing performance, one of these limits called “big data in small files” accrued when a massive number of small files pushed into a hadoop cluster which will rides the cluster to shut down totally. This paper also high light on some native and proposed solutions for big data in small files, how do they work to reduce the negative effects on hadoop cluster, and add extra performance on storing and accessing mechanism.&lt;/jats:p&gt;</dc:description><dc:publisher>Institute of Advanced Engineering and Science</dc:publisher><dc:date>2020-04-01</dc:date><dc:type>info:eu-repo/semantics/article</dc:type><dc:format>application/pdf</dc:format><dc:identifier>https://doi.org/10.11591/ijece.v10i2.pp2097-2101</dc:identifier><dc:identifier>10.11591/ijece.v10i2.pp2097-2101</dc:identifier><dc:source>International Journal of Electrical and Computer Engineering (IJECE); Vol 10 No 2 (2020); 2097</dc:source><dc:source>2088-8708</dc:source><dc:source>2088-8708</dc:source><dc:relation>http://ijece.iaescore.com/index.php/IJECE/article/viewFile/20039/pdf</dc:relation><dc:rights>http://creativecommons.org/licenses/by-nc/4.0</dc:rights></oai_dc:dc>