Spiking Neural Network based Real-time Radar Gesture Recognition Live Demonstration

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/GutachtenBeitrag in KonferenzbandBeigetragenBegutachtung

Beitragende

Abstract

This live demo aims at continuously real-time classifying radar gesture signals from the real world with the neuromorphic hardware SpiNNaker 2 prototype to play the game. With the 10 MHz operation frequency on SpiNNaker 2 FPGA, the closed-loop setup realizes around 35 ms delay from PC sending input data to receiving classification output, and there is nearly no feeling of apparent delay when testers are playing the game. Energy cost per frame on SpiNNaker 2 is 3.29 μJ, and the operation cycle accounts for less than 8 k. Even if our current middleware has not considered balanced work loading among different processing cores, the tightly couple memory usage on the heaviest loaded processing element is less than half of the total 128 kB available memory space based on the directly trained gesture recognition spiking neural network (SNN) model with 2048 input neurons, 5 hidden neurons, and 4 classification outputs.

Details

OriginalspracheEnglisch
Titel2022 IEEE 4th International Conference on Artificial Intelligence Circuits and Systems (AICAS)
Seiten500
Seitenumfang1
ISBN (elektronisch)978-1-6654-0996-4
PublikationsstatusVeröffentlicht - 2022
Peer-Review-StatusJa

Konferenz

Titel4th IEEE International Conference on Artificial Intelligence Circuits and Systems
KurztitelIEEE AICAS 2022
Veranstaltungsnummer4
Dauer13 - 15 Juni 2022
Webseite
OrtSongdo Convensia & online
StadtIncheon
LandSüdkorea

Externe IDs

Scopus 85139023616

Schlagworte

Schlagwörter

  • SpiNNaker 2, gesture recognition, radar, real-time, spiking neural network