Akses terbuka Jurnal SINTA 1
Optimizing deep learning models from multi-objective perspective via Bayesian optimization
IAES International Journal of Artificial Intelligence · Vol. 14 No. 2 (2025) · hlm. 1420–1429
- ISSN
- 2252-8938, 2089-4872
- Terbit
- 2025-04-01
- Penerbit
- Institute of Advanced Engineering and Science
- Bahasa
- eng
Abstrak
Optimizing hyperparameters is crucial for enhancing the performance of deep learning (DL) models. The process of configuring optimal hyperparameters, known as hyperparameter tuning, can be performed using various methods. Traditional approaches like grid search and random search have significant limitations. In contrast, Bayesian optimization (BO) utilizes a surrogate model and an acquisition function to intelligently navigate the hyperparameter space, aiming to provide deeper insights into performance disparities between naïve and advanced methods. This study evaluates BO's efficacy compared to baseline methods such as random search, manual search, and grid search across multiple DL architectures, including multi-layer perceptron (MLP), convolutional neural network (CNN), and LeNet, applied to the Modified National Institute of Standards and Technology (MNIST) and CIFAR-10 datasets. The findings indicate that BO, employing the tree-structured parzen estimator (TPE) search method and expected improvement (EI) acquisition function, surpasses alternative methods in intricate DL architectures such as LeNet and CNN. However, grid search shows superior performance in smaller DL architectures like MLP. This study also adopts a multi-objective (MO) perspective, balancing conflicting performance objectives such as accuracy, F1 score, and model size (parameter count). This MO assessment offers a comprehensive understanding of how these performance metrics interact and influence each other, leading to more informed hyperparameter tuning decisions.
Kata kunci
Jaringan kolaborasi para penulis
36 penulis · 98 tautan kepenulisan bersama · 13 lintas organisasi
Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.
- Universiti Teknologi MARA
- HELP University
- State University of Semarang
- Universiti Malaysia Pahang Al-Sultan Abdullah
- Organisasi berbeda
- Organisasi sama
- Afiliasi tidak diketahui
- Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
| Rekan penulis | Organisasi | Artikel bersama |
|---|---|---|
| Nurbaity Sabri | Universiti Teknologi MARA | 4 |
| Nor Azura Md Ghani | Universiti Teknologi MARA | 3 |
| Raseeda Hamzah | Universiti Teknologi MARA | 3 |
| Syed Mohd Zahid Syed Zainal Ariffin | Universiti Teknologi MARA | 2 |
| Raihah Aminuddin | Universiti Teknologi MARA | 2 |
| Nur Nabilah Abu Mangshor | Universiti Teknologi MARA | 2 |
| Saadi Bin Ahmad Kamaruddin | HELP University | 2 |
| Zaidah Ibrahim | Universiti Teknologi MARA | 2 |
| Marshima Mohd Rosli | Universiti Teknologi MARA | 1 |
| Xiaoling Gao | Universiti Teknologi MARA | 1 |
| Muhammad Izzad Ramli | Universiti Teknologi MARA | 1 |
| Budi Sunarko | State University of Semarang | 1 |
| Nur Afiqah Mohd Fuad | Universiti Teknologi MARA | 1 |
| Ruiyun Qiu | Universiti Teknologi MARA | 1 |
| Siti Khatijah Nor Abdul Rahim | Universiti Teknologi MARA | 1 |
| Nor Diana Ahmad | Universiti Teknologi MARA | 1 |
| Rosniza Roslan | Universiti Teknologi MARA | 1 |
| Nurul Shafekah Kassim | Universiti Teknologi MARA | 1 |
| Nurul Amirah Zulkifli | Universiti Teknologi MARA | 1 |
| Anis Amilah Shari | Universiti Teknologi MARA | 1 |
| Mohd Rahmat Mohd Noordin | Universiti Teknologi MARA | 1 |
| Azlee Zabidi | Universiti Malaysia Pahang Al-Sultan Abdullah | 1 |
| Iylia Ashiqin Abdul Majid | Universiti Teknologi MARA | 1 |
| Khyrina Airin Fariza Abu Samah | Universiti Teknologi MARA | 1 |
| Nurul Amira Mohd Ali | Universiti Teknologi MARA | 1 |
| Hazrita Ab Rahim | HELP University | 1 |
| Ismail Musirin | Universiti Teknologi MARA | 1 |
| Muhammad Fareez Rashdan | Universiti Teknologi MARA | 1 |
| Nor Masri Sahri | Universiti Teknologi MARA | 1 |
| Norizah Ardi | Universiti Teknologi MARA | 1 |
| Izzad Ramli | Universiti Teknologi MARA | 1 |
| Gehad Saleh Ahmed Mohammed | Universiti Teknologi MARA | 1 |
| Norizan Mat Diah | Universiti Teknologi MARA | 1 |
Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.