Akses terbuka Jurnal SINTA 1
Spike neuron optimization using deep reinforcement learning
IAES International Journal of Artificial Intelligence · Vol. 10 No. 1 (2021) · hlm. 175–183
- ISSN
- 2252-8938, 2089-4872
- Terbit
- 2021-03-01
- Penerbit
- Institute of Advanced Engineering and Science
- Bahasa
- eng
Abstrak
Deep reinforcement learning (DRL) which involved reinforcement learning and artificial neural network allows agents to take the best possible actions to achieve goals. Spiking Neural Network (SNN) faced difficulty in training due to the non-differentiable spike function of spike neuron. In order to overcome the difficulty, Deep Q network (DQN) and Deep Q learning with normalized advantage function (NAF) are proposed to interact with a custom environment. DQN is applied for discrete action space whereas NAF is implemented for continuous action space. The model is trained and tested to validate its performance in order to balance the firing rate of excitatory and inhibitory population of spike neuron by using both algorithms. Training results showed both agents able to explore in the custom environment with OpenAI Gym framework. The trained model for both algorithms capable to balance the firing rate of excitatory and inhibitory of the spike neuron. NAF achieved 0.80% of the average percentage error of rate of difference between target and actual neuron rate whereas DQN obtained 0.96%. NAF attained the goal faster than DQN with only 3 steps taken for actual output neuron rate to meet with or close to target neuron firing rate.
Kata kunci
Jaringan kolaborasi para penulis
22 penulis · 47 tautan kepenulisan bersama · 26 lintas organisasi
Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.
- Universiti Sains Malaysia
- Prasad V. Potluri Siddhartha Institute of Technology
- Bahrain Polytechnic
- Universiti Teknologi Petronas
- Vignan's Foundation for Science, Technology & Research
- Koneru Lakshmaiah Education Foundation
- R.V. College of Engineering
- Organisasi lain
- Organisasi berbeda
- Organisasi sama
- Afiliasi tidak diketahui
- Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
| Rekan penulis | Organisasi | Artikel bersama |
|---|---|---|
| Zainatul Yushaniza Mohamed Yusoff | Universiti Sains Malaysia | 2 |
| Lukman Ab. Rahim | Universiti Teknologi Petronas | 2 |
| Kilari Jyothsna Devi | Prasad V. Potluri Siddhartha Institute of Technology | 1 |
| Ravuri Daniel | Prasad V. Potluri Siddhartha Institute of Technology | 1 |
| Bode Prasad | Vignan's Foundation for Science, Technology & Research | 1 |
| Dorababu Sudarsa | Koneru Lakshmaiah Education Foundation | 1 |
| Prudhvi Kiran Pasam | R.V. College of Engineering | 1 |
| Ching Chia Leong | Universiti Sains Malaysia | 1 |
| Yew Ho Hee | Universiti Sains Malaysia | 1 |
| Mohd Shahrimie Mohd Asaari | Universiti Sains Malaysia | 1 |
| Mohamad Tarmizi Abu Seman | Universiti Sains Malaysia | 1 |
| Nada Masood Mirza | Universiti Sains Malaysia | 1 |
| Adnan Ali | Universiti Sains Malaysia | 1 |
| Hassam Muazzam | Universiti Sains Malaysia | 1 |
| Athar Hanif | The Ohio State University | 1 |
| Selvakumar Manickam | Universiti Sains Malaysia | 1 |
| Shankar Karuppayah | Universiti Sains Malaysia | 1 |
| Shams Ul Arfeen Laghari | Bahrain Polytechnic | 1 |
| Muhammad Syahir Kamal Fitri | Universiti Sains Malaysia | 1 |
| Siang Kok Chia | Bahrain Polytechnic | 1 |
Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.