Hardware-Aware Fine-Tuning of Spiking Q-Networks on the SpiNNaker2 Neuromorphic Platform

Research output: Contribution to conferencesPaperContributedpeer-review

Abstract

Spiking Neural Networks (SNNs) promise orders-of-magnitude lower power consumption and low-latency inference on neuromorphic hardware for a wide range of robotic tasks. In this work, we present an energy-efficient implementation of a reinforcement learning (RL) algorithm using quantized SNNs to solve two classical control tasks. The network is trained using the Q-learning algorithm, then fine-tuned and quantized to low-bit (8-bit) precision for embedded deployment on the SpiNNaker2 neuromorphic chip. To evaluate the comparative advantage of SpiNNaker2 over conventional computing platforms, we analyze inference latency, dynamic power consumption, and energy cost per inference for our SNN models, comparing performance against a GTX 1650 GPU baseline. Our results demonstrate SpiNNaker2's strong potential for scalable, low-energy neuromorphic computing, achieving up to 32× reduction in energy consumption. Inference latency remains on par with GPU-based execution, with improvements observed in certain task settings, reinforcing SpiNNaker2's viability for real-time neuromorphic control, making the neuromorphic approach a compelling direction for efficient deep Q-learning.

Details

Original languageEnglish
Pages74-81
Number of pages8
Publication statusPublished - 26 Nov 2025
Peer-reviewedYes

Conference

Title2025 International Conference on Neuromorphic Systems
Abbreviated titleICONS 2025
Duration29 - 31 July 2025
Website
LocationHyatt Regency Bellevue on Seattle’s Eastside & Online
CitySeattle
CountryUnited States of America

Keywords

Sustainable Development Goals

Keywords

  • energy-efficient computing, neuromorphic hardware, quantization, reinforcement learning, spiking neural networks