Efficient Algorithms for Accelerating Spiking Neural Networks on MAC Array of SpiNNaker 2
Research output: Contribution to book/Conference proceedings/Anthology/Report › Conference contribution › Contributed › peer-review
Contributors
Abstract
The CPU-based system is widely used for simulating the brain-inspired spiking neural networks (SNN) by taking the benefit of flexibility, while processing high input spiking rates caused by immature coding mechanism costs many CPU cycles, and the introduction of additional information required by serial execution needs the time-consuming pre- and post-neuron matching algorithm. To address these issues, we propose an algorithm set leveraging the multiply-accumulate (MAC) array to accelerate the SNN inference. By rearranging and compressing operands losslessly, we retain the advantage of the MAC array on fast parallel computing, as well as alleviate the ineffective memory occupation and the waste of computing resources, which result from the inherent sparse feature of SNN and reluctant memory alignment from fixed MAC hardware structure. Benchmarking with an SNN radar gesture recognition model, the algorithms jointly optimize 82.71% of the execution time compared to the serial computation on the ARM M4F of the SpiNNaker 2 chip; 49.89% of the memory footprint is reduced contrasted with the unoptimized MAC calculation. This article explicitly expands the application field of the General Sparse Matrix-Matrix Multiplication (SpGEMM) issue to SNN, developing novel SpGEMM optimization algorithms fitting the SNN feature and MAC array.
Details
Original language | English |
---|---|
Title of host publication | 2023 IEEE 5th International Conference on Artificial Intelligence Circuits and Systems (AICAS) |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 1-5 |
Number of pages | 5 |
ISBN (electronic) | 979-8-3503-3267-4 |
ISBN (print) | 979-8-3503-3268-1 |
Publication status | Published - 13 Jun 2023 |
Peer-reviewed | Yes |
Publication series
Series | IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) |
---|
Conference
Title | 5th IEEE International Conference on Artificial Intelligence Circuits and Systems |
---|---|
Abbreviated title | IEEE AICAS 2023 |
Conference number | 5 |
Duration | 11 - 13 June 2023 |
Website | |
Location | Grand Hyatt Hangzhou |
City | Hangzhou |
Country | China |
External IDs
Scopus | 85166373258 |
---|---|
Ieee | 10.1109/AICAS57966.2023.10168559 |
Keywords
ASJC Scopus subject areas
Keywords
- Neuromorphic computing, SNN, SpGEMM, SpiNNaker 2, multiply-accumulate, parallel computing