Jurnal Tanpa peringkat SINTA
Robustness of Bayesian-Optimized Random Forest Against Feature-Space Evasion Attacks for Spam Detection
Recursive Journal of Informatics · Vol. 4 No. 2 (2026) · hlm. 137–148
- ISSN
- 2986-6588, 2963-5551
- Terbit
- 2026-09-30
- Penerbit
- Universitas Negeri Semarang
- Bahasa
- eng
Abstrak
Abstract. Email spam filters may perform well on unmodified messages yet remain vulnerable to deliberate feature manipulation. Although hyperparameter optimization can improve clean-data performance, such gains do not establish robustness under test-time perturbations. A paired, leakage-controlled evaluation is therefore needed to assess both properties under identical conditions. Purpose: This study compared the clean classification performance and feature-space robustness of a library-default Random Forest (RF-default) and a Bayesian-optimized Random Forest (BO-RF) on Spambase. Methods/Study design/approach: Exact duplicates were removed, and predictor-identical records were grouped to prevent cross-fold leakage. Evaluation used two repetitions of five-fold nested stratified group-aware cross-validation with shared outer folds. Bayesian Optimization maximized inner-validation spam-class F1. Frozen outer-test folds were assessed on clean inputs, class-center-directed perturbations at α = 0.05, 0.10, 0.20, and 0.40, and 30 magnitude-matched random directions. Retained inference assessed within-model clean-versus-directed and directed-versus-random contrasts in F1, Recall, and model-specific attack success rate (ASR). Result/Findings: BO-RF yielded slightly higher means across all four clean metrics; clean F1 was 93.65 ± 0.88% versus 93.53 ± 0.98% for RF-default. Bayesian Optimization selected the effective default configuration in nine of ten outer folds. At directed α = 0.40, F1 fell to 85.20% for RF-default and 85.31% for BO-RF, while Recall fell to 77.94% and 78.03%, respectively; directed ASR was approximately 15.5% for both models. All 48 retained within-model contrasts met Holm-adjusted thresholds, indicating degradation relative to clean inputs and a stronger effect of directed than magnitude-matched random perturbations. No direct between-model inferential family was retained, so robustness comparisons remain descriptive. Novelty/Originality/Value: Under the evaluated Spambase feature-space setting, clean-F1 Bayesian Optimization yielded only marginal descriptive gains and did not demonstrate a clear robustness advantage over the effective RF-default configuration. The findings show that clean-metric optimization should not be treated as a proxy for evasion robustness.
Kata kunci
Jaringan kolaborasi para penulis
40 penulis · 96 tautan kepenulisan bersama · 8 lintas organisasi · menampilkan 40 yang paling banyak terhubung
Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.
- State University of Semarang
- International Islamic University Malaysia
- Universitas PGRI Palembang
- Afiliasi tidak diketahui
- Organisasi berbeda
- Organisasi sama
- Afiliasi tidak diketahui
- Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
| Rekan penulis | Organisasi | Artikel bersama |
|---|---|---|
| Endang Sugiharti | State University of Semarang | 6 |
| Florentina Yuni Arini | State University of Semarang | 3 |
| Rochmad Rochmad | International Islamic University Malaysia | 3 |
| Amin Suyitno | State University of Semarang | 3 |
| Alamsyah Alamsyah | State University of Semarang | 2 |
| Novanka Agnes Sekartaji | State University of Semarang | 2 |
| Irfan Fajar Muttaqin | State University of Semarang | 2 |
| Ramadhan Ridho Arrohman | State University of Semarang | 2 |
| Dwijanto Dwijanto | State University of Semarang | 2 |
| Putriaji Hendikawati | State University of Semarang | 2 |
| Budi Prasetiyo | State University of Semarang | 1 |
| Much Aziz Muslim | State University of Semarang | 1 |
| Jumanto Jumanto | State University of Semarang | 1 |
| Rofik Rofik | State University of Semarang | 1 |
| Arif Widiyatmoko | State University of Semarang | 1 |
| Stephani Diah Pamelasari | State University of Semarang | 1 |
| Arka Yanitama | State University of Semarang | 1 |
| Melissa Salma Darmawan | State University of Semarang | 1 |
| Aji Saputra | Universitas PGRI Palembang | 1 |
| Desy Fitria Astutianingtyas | Afiliasi tidak diketahui | 1 |
| Syafa Nabilah Syahputra | State University of Semarang | 1 |
| Anggyi Trisnawan Putra | State University of Semarang | 1 |
| Athoillah Athoillah | State University of Semarang | 1 |
| Kholiq Budiman | Afiliasi tidak diketahui | 1 |
| Anggyi Trisnawan Putra | Afiliasi tidak diketahui | 1 |
| zaenal abidin | Afiliasi tidak diketahui | 1 |
| Anggoro Sakti Anindhito | State University of Semarang | 1 |
| Fajar Sujito | Afiliasi tidak diketahui | 1 |
| Anita Wahyu Melinda | Afiliasi tidak diketahui | 1 |
| Isa Akhlis | State University of Semarang | 1 |
| Achmad Wahyu Hidayat | Afiliasi tidak diketahui | 1 |
| Dian Rahman Syahputra | Afiliasi tidak diketahui | 1 |
| Safit Firmansyah | Afiliasi tidak diketahui | 1 |
| Anggil Agusta | Afiliasi tidak diketahui | 1 |
| Fachrizal Ahdy Andoyo | State University of Semarang | 1 |
| Margareta Ayu Riantik | State University of Semarang | 1 |
| Dandi Indra Wijaya | Afiliasi tidak diketahui | 1 |
| Hanif Nur Cahyani | Afiliasi tidak diketahui | 1 |
Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.