Efficient Algorithms for Accelerating Spiking Neural Networks on MAC Array of SpiNNaker 2
Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/Gutachten › Beitrag in Konferenzband › Beigetragen › Begutachtung
Beitragende
Abstract
The CPU-based system is widely used for simulating the brain-inspired spiking neural networks (SNN) by taking the benefit of flexibility, while processing high input spiking rates caused by immature coding mechanism costs many CPU cycles, and the introduction of additional information required by serial execution needs the time-consuming pre- and post-neuron matching algorithm. To address these issues, we propose an algorithm set leveraging the multiply-accumulate (MAC) array to accelerate the SNN inference. By rearranging and compressing operands losslessly, we retain the advantage of the MAC array on fast parallel computing, as well as alleviate the ineffective memory occupation and the waste of computing resources, which result from the inherent sparse feature of SNN and reluctant memory alignment from fixed MAC hardware structure. Benchmarking with an SNN radar gesture recognition model, the algorithms jointly optimize 82.71% of the execution time compared to the serial computation on the ARM M4F of the SpiNNaker 2 chip; 49.89% of the memory footprint is reduced contrasted with the unoptimized MAC calculation. This article explicitly expands the application field of the General Sparse Matrix-Matrix Multiplication (SpGEMM) issue to SNN, developing novel SpGEMM optimization algorithms fitting the SNN feature and MAC array.
Details
Originalsprache | Englisch |
---|---|
Titel | 2023 IEEE 5th International Conference on Artificial Intelligence Circuits and Systems (AICAS) |
Herausgeber (Verlag) | Institute of Electrical and Electronics Engineers Inc. |
Seiten | 1-5 |
Seitenumfang | 5 |
ISBN (elektronisch) | 979-8-3503-3267-4 |
ISBN (Print) | 979-8-3503-3268-1 |
Publikationsstatus | Veröffentlicht - 13 Juni 2023 |
Peer-Review-Status | Ja |
Publikationsreihe
Reihe | IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) |
---|
Konferenz
Titel | 5th IEEE International Conference on Artificial Intelligence Circuits and Systems |
---|---|
Kurztitel | IEEE AICAS 2023 |
Veranstaltungsnummer | 5 |
Dauer | 11 - 13 Juni 2023 |
Webseite | |
Ort | Grand Hyatt Hangzhou |
Stadt | Hangzhou |
Land | China |
Externe IDs
Scopus | 85166373258 |
---|---|
Ieee | 10.1109/AICAS57966.2023.10168559 |
Schlagworte
ASJC Scopus Sachgebiete
Schlagwörter
- Neuromorphic computing, SNN, SpGEMM, SpiNNaker 2, multiply-accumulate, parallel computing