Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

The impact of training data selection on the software defect prediction performance and data complexity

Bulletin of Electrical Engineering and Informatics · Vol. 11 No. 5 (2022) · hlm. 2903–2921

DOI
10.11591/eei.v11i5.3698
ISSN
2089-3191, 2302-9285
Terbit
2022-08-19
Penerbit
Institute of Advanced Engineering and Science (IAES)
Bahasa
en
Lisensi
creativecommons.org/licenses/by-sa/4.0/

Abstrak

Directly learning a defect prediction model from cross-project datasets results in a model with poor performance. Hence, training data selection becomes a feasible solution to this problem. Limited comparative studies investigating the effect of training data selection on the prediction performance have presented contradictory results. Those studies also did not analyze why a training data selection method underperforms. This study aims to investigate the impact of training data selection on the defect prediction model and data complexity measures. The method is based on an empirical comparison between prediction performance and data complexity measure before and after selection. This study compared 13 training data selection methods on 61 projects using six classification algorithms and measured the data complexity using six complexity measures focusing on overlap class, noise level, and class imbalanced ratio. Experimental results indicate that the best method for each dataset varies depending on the dataset and classifiers. The training data selection most affects noise rate and class imbalance. We concluded that critically selecting the training data method could improve the performance of the prediction model. We recommend dealing with noise and unbalanced classes when designing training data methods.

Kata kunci

Jaringan kolaborasi para penulis

20 penulis · 49 tautan kepenulisan bersama · 14 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Universiti Teknikal Malaysia Melaka
  • Universitas Masoem
  • Politeknik Muadzam Shah
  • International University of Batam
  • Universiti Utara Malaysia
  • Afiliasi tidak diketahui
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Lizawati Binti SalahuddinUniversiti Teknikal Malaysia Melaka2
Ummi Rabaah HashimUniversiti Teknikal Malaysia Melaka2
Teo Hong ChunUniversiti Teknikal Malaysia Melaka1
Ummi Raba’ah HashimAfiliasi tidak diketahui1
Ngo Hea ChoonUniversiti Teknikal Malaysia Melaka1
Kasturi KanchymalayUniversiti Teknikal Malaysia Melaka1
Rita KomalasariUniversitas Masoem1
Bambang SiswoyoUniversitas Masoem1
Ahmad Naim Che PeeUniversiti Teknikal Malaysia Melaka1
Nano SuyatnaAfiliasi tidak diketahui1
Rafizah Ab RahmanPoliteknik Muadzam Shah1
Nur Dalila AbdullahPoliteknik Muadzam Shah1
Nurhamizah ZainudinAfiliasi tidak diketahui1
Intan Ermahani A. JalilUniversiti Teknikal Malaysia Melaka1
Hepy Hefri AriyantoInternational University of Batam1
Mazida Binti AhmadUniversiti Utara Malaysia1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OpenAlex API (jurnal SINTA, ADR 0048) https://openalex.org/S2765016208, pertama di-harvest 19 Nov 2026, terakhir terlihat 19 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/"><dc:title xml:lang="en">The impact of training data selection on the software defect prediction performance and data complexity</dc:title><dc:creator>Benyamin Langgu Sinaga</dc:creator><dc:creator>Sabrina Ahmad</dc:creator><dc:creator>Zuraida Abal Abas</dc:creator><dc:creator>Antasena Wahyu Anggarajati</dc:creator><dc:subject>software defect prediction</dc:subject><dc:subject>training data selection</dc:subject><dc:subject>data complexity measures</dc:subject><dc:subject>class imbalance</dc:subject><dc:subject>noise rate</dc:subject><dc:subject>machine learning classifiers</dc:subject><dc:description xml:lang="en">Directly learning a defect prediction model from cross-project datasets results in a model with poor performance. Hence, training data selection becomes a feasible solution to this problem. Limited comparative studies investigating the effect of training data selection on the prediction performance have presented contradictory results. Those studies also did not analyze why a training data selection method underperforms. This study aims to investigate the impact of training data selection on the defect prediction model and data complexity measures. The method is based on an empirical comparison between prediction performance and data complexity measure before and after selection. This study compared 13 training data selection methods on 61 projects using six classification algorithms and measured the data complexity using six complexity measures focusing on overlap class, noise level, and class imbalanced ratio. Experimental results indicate that the best method for each dataset varies depending on the dataset and classifiers. The training data selection most affects noise rate and class imbalance. We concluded that critically selecting the training data method could improve the performance of the prediction model. We recommend dealing with noise and unbalanced classes when designing training data methods.</dc:description><dc:publisher>Institute of Advanced Engineering and Science (IAES)</dc:publisher><dc:date>2022-08-19</dc:date><dc:type>info:eu-repo/semantics/article</dc:type><dc:format>application/pdf</dc:format><dc:identifier>https://doi.org/10.11591/eei.v11i5.3698</dc:identifier><dc:identifier>10.11591/eei.v11i5.3698</dc:identifier><dc:source>Bulletin of Electrical Engineering and Informatics; Vol 11 No 5 (2022); 2903-2921</dc:source><dc:source>2089-3191</dc:source><dc:source>2302-9285</dc:source><dc:language>en</dc:language><dc:relation>https://beei.org/index.php/EEI/article/download/3698/2959</dc:relation><dc:rights>https://creativecommons.org/licenses/by-sa/4.0/</dc:rights></oai_dc:dc>