Melola Discovery

← Melola Discovery

Akses terbuka Jurnal SINTA 1

Spike neuron optimization using deep reinforcement learning

IAES International Journal of Artificial Intelligence · Vol. 10 No. 1 (2021) · hlm. 175–183

DOI
10.11591/ijai.v10.i1.pp175-183
ISSN
2252-8938, 2089-4872
Terbit
2021-03-01
Penerbit
Institute of Advanced Engineering and Science
Bahasa
eng
Lisensi
creativecommons.org/licenses/by-sa/4.0

Abstrak

Deep reinforcement learning (DRL) which involved reinforcement learning and artificial neural network allows agents to take the best possible actions to achieve goals. Spiking Neural Network (SNN) faced difficulty in training due to the non-differentiable spike function of spike neuron. In order to overcome the difficulty, Deep Q network (DQN) and Deep Q learning with normalized advantage function (NAF) are proposed to interact with a custom environment. DQN is applied for discrete action space whereas NAF is implemented for continuous action space. The model is trained and tested to validate its performance in order to balance the firing rate of excitatory and inhibitory population of spike neuron by using both algorithms. Training results showed both agents able to explore in the custom environment with OpenAI Gym framework. The trained model for both algorithms capable to balance the firing rate of excitatory and inhibitory of the spike neuron. NAF achieved 0.80% of the average percentage error of rate of difference between target and actual neuron rate whereas DQN obtained 0.96%. NAF attained the goal faster than DQN with only 3 steps taken for actual output neuron rate to meet with or close to target neuron firing rate.

Kata kunci

Jaringan kolaborasi para penulis

22 penulis · 47 tautan kepenulisan bersama · 26 lintas organisasi

Arahkan kursor atau ketuk sebuah nama untuk menyorot rekan penulisnya. Klik dua kali untuk membuka halaman penulis.

  • Universiti Sains Malaysia
  • Prasad V. Potluri Siddhartha Institute of Technology
  • Bahrain Polytechnic
  • Universiti Teknologi Petronas
  • Vignan's Foundation for Science, Technology & Research
  • Koneru Lakshmaiah Education Foundation
  • R.V. College of Engineering
  • Organisasi lain
  • Organisasi berbeda
  • Organisasi sama
  • Afiliasi tidak diketahui
  • Garis lebih tebal = lebih banyak artikel bersama · lingkaran lebih besar = lebih banyak artikel
Tampilkan sebagai tabel
Rekan penulisOrganisasiArtikel bersama
Zainatul Yushaniza Mohamed YusoffUniversiti Sains Malaysia2
Lukman Ab. RahimUniversiti Teknologi Petronas2
Kilari Jyothsna DeviPrasad V. Potluri Siddhartha Institute of Technology1
Ravuri DanielPrasad V. Potluri Siddhartha Institute of Technology1
Bode PrasadVignan's Foundation for Science, Technology & Research1
Dorababu SudarsaKoneru Lakshmaiah Education Foundation1
Prudhvi Kiran PasamR.V. College of Engineering1
Ching Chia LeongUniversiti Sains Malaysia1
Yew Ho HeeUniversiti Sains Malaysia1
Mohd Shahrimie Mohd AsaariUniversiti Sains Malaysia1
Mohamad Tarmizi Abu SemanUniversiti Sains Malaysia1
Nada Masood MirzaUniversiti Sains Malaysia1
Adnan AliUniversiti Sains Malaysia1
Hassam MuazzamUniversiti Sains Malaysia1
Athar HanifThe Ohio State University1
Selvakumar ManickamUniversiti Sains Malaysia1
Shankar KaruppayahUniversiti Sains Malaysia1
Shams Ul Arfeen LaghariBahrain Polytechnic1
Muhammad Syahir Kamal FitriUniversiti Sains Malaysia1
Siang Kok ChiaBahrain Polytechnic1

Afiliasi berasal dari OpenAlex; metadata OAI-PMH jurnal tidak memuatnya. Penulis tanpa ID OpenAlex dicocokkan berdasarkan nama, sehingga dua orang bisa tergabung atau satu orang bisa terpisah.

Sumber metadata: OAI-PMH (metadata jurnal) http://ijai.iaescore.com/index.php/IJAI/oai, pertama di-harvest 8 Nov 2026, terakhir terlihat 16 Nov 2026.
Metadata asli (oai_dc)
<oai_dc:dc xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/  http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
	<dc:title xml:lang="en-US">Spike neuron optimization using deep reinforcement learning</dc:title>
	<dc:creator>Szi Hui, Tan</dc:creator>
	<dc:creator>Khairi Ishak, Mohamad</dc:creator>
	<dc:subject xml:lang="en-US"></dc:subject>
	<dc:subject xml:lang="en-US">Deep Q network; Deep reinforcement learning; Spike neuron</dc:subject>
	<dc:description xml:lang="en-US">Deep reinforcement learning (DRL) which involved reinforcement learning and artificial neural network allows agents to take the best possible actions to achieve goals. Spiking Neural Network (SNN) faced difficulty in training due to the non-differentiable spike function of spike neuron. In order to overcome the difficulty, Deep Q network (DQN) and Deep Q learning with normalized advantage function (NAF) are proposed to interact with a custom environment. DQN is applied for discrete action space whereas NAF is implemented for continuous action space. The model is trained and tested to validate its performance in order to balance the firing rate of excitatory and inhibitory population of spike neuron by using both algorithms. Training results showed both agents able to explore in the custom environment with OpenAI Gym framework. The trained model for both algorithms capable to balance the firing rate of excitatory and inhibitory of the spike neuron. NAF achieved 0.80% of the average percentage error of rate of difference between target and actual neuron rate whereas DQN obtained 0.96%. NAF attained the goal faster than DQN with only 3 steps taken for actual output neuron rate to meet with or close to target neuron firing rate.</dc:description>
	<dc:publisher xml:lang="en-US">Institute of Advanced Engineering and Science</dc:publisher>
	<dc:contributor xml:lang="en-US"></dc:contributor>
	<dc:date>2021-03-01</dc:date>
	<dc:type>info:eu-repo/semantics/article</dc:type>
	<dc:type>info:eu-repo/semantics/publishedVersion</dc:type>
	<dc:type xml:lang="en-US"></dc:type>
	<dc:format>application/pdf</dc:format>
	<dc:identifier>https://ijai.iaescore.com/index.php/IJAI/article/view/20839</dc:identifier>
	<dc:identifier>10.11591/ijai.v10.i1.pp175-183</dc:identifier>
	<dc:source xml:lang="en-US">IAES International Journal of Artificial Intelligence (IJ-AI); Vol 10, No 1: March 2021; 175-183</dc:source>
	<dc:source>2252-8938</dc:source>
	<dc:source>2089-4872</dc:source>
	<dc:source>10.11591/ijai.v10.i1</dc:source>
	<dc:language>eng</dc:language>
	<dc:relation>https://ijai.iaescore.com/index.php/IJAI/article/view/20839/13074</dc:relation>
	<dc:rights xml:lang="en-US">Copyright (c) 2021 Institute of Advanced Engineering and Science</dc:rights>
	<dc:rights xml:lang="en-US">http://creativecommons.org/licenses/by-sa/4.0</dc:rights>
</oai_dc:dc>