DOE OSTI · 1814329
Multi-Objective Hyperparameter Optimization for Spiking Neural Network Neuroevolution
Abstract
Neuroevolution has had significant success over recent years, but there has been relatively little work applying neuroevolution approaches to spiking neural networks (SNNs). SNNs are a type of neural network that includes temporal processing component, are not easily trained using other methods, and can be deployed into energy-efficient neuromorphic hardware. In this work, we investigate two evolutionary approaches for training SNNs. We explore the impact of the hyperparameters of the evolutionary approaches, including tournament size, population size, and representation type, on the performance of the algorithms. We present a multi-objective Bayesian-based hyperparameter optimization approach to tune the hyperparameters to produce the most accurate and smallest SNNs. We show that the hyperparameters can significantly affect the performance of these algorithms. We also perform sensitivity analysis and demonstrate that every hyperparameter value has the potential to perform well, assuming other hyperparameter values are set correctly.
Keep this discovery
Explore connections, maps & timelines
Parsa, Maryam, Kulkarni, Shruti, Coletti, Mark, Bassett, Jeffrey K., Mitchell, Parker, Schuman, Catherine. 2021-06-01. Multi-Objective Hyperparameter Optimization for Spiking Neural Network Neuroevolution. https://doi.org/10.1109/cec45853.2021.9504897. https://engineeringpapers.com/record/osti%3A1814329/multi-objective-hyperparameter-optimization-for-spiking-neural-network-neuroevolution
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Engineering Papers by Indiciae: BibTeX · RIS.