Real-time Radar Gesture Classification with Spiking Neural Network on SpiNNaker 2 Prototype

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/GutachtenBeitrag in KonferenzbandBeigetragenBegutachtung

Beitragende

Abstract

Neuromorphic hardware has been emerging in recent years, seeking various applications to explore its uniqueness, limitations, and possibilities. As a representative application and research area, gesture recognition is gaining wider popularity, while the conflict of spiking neural network (SNN) size and available memory of neuromorphic edge-AI can be a thorny issue, which is even intensified by the demand for continuously processing input data stream from the sensor in the real-world scenario since a certain amount of memory is required to ensure that no data loss or overwrite happens. In this paper, an SNN-based real-time radar gesture recognition closed-loop system is proposed, with Infineon’s 60 GHz radar continuously capturing motion and the multi-core neuromorphic hardware SpiNNaker 2 serving as the backend to classify gestures with an SNN. A PC is used to pre-process the data and manipulate an actuator. This system requires less than 8 k operation cycles per processor for each radar frame and achieves a classification accuracy of 98.83-bit quantized model, with only 134.2 kB memory usage on three processing elements (PEs) and low energy cost. Besides, it performs well in the real-time closed-loop test with 35 ms latency.

Details

OriginalspracheEnglisch
Titel2022 IEEE 4th International Conference on Artificial Intelligence Circuits and Systems (AICAS)
Seiten362-365
Seitenumfang4
ISBN (elektronisch)978-1-6654-0996-4
PublikationsstatusVeröffentlicht - 2022
Peer-Review-StatusJa

Externe IDs

Scopus 85139027027

Schlagworte

Schlagwörter

  • SNN, SpiNNaker 2, gesture recognition, multi-core processor, neuromorphic hardware, radar, real-time