Spiking Neural Network based Real-time Radar Gesture Recognition Live Demonstration

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Contributors

Abstract

This live demo aims at continuously real-time classifying radar gesture signals from the real world with the neuromorphic hardware SpiNNaker 2 prototype to play the game. With the 10 MHz operation frequency on SpiNNaker 2 FPGA, the closed-loop setup realizes around 35 ms delay from PC sending input data to receiving classification output, and there is nearly no feeling of apparent delay when testers are playing the game. Energy cost per frame on SpiNNaker 2 is 3.29 μJ, and the operation cycle accounts for less than 8 k. Even if our current middleware has not considered balanced work loading among different processing cores, the tightly couple memory usage on the heaviest loaded processing element is less than half of the total 128 kB available memory space based on the directly trained gesture recognition spiking neural network (SNN) model with 2048 input neurons, 5 hidden neurons, and 4 classification outputs.

Details

Original languageEnglish
Title of host publication2022 IEEE 4th International Conference on Artificial Intelligence Circuits and Systems (AICAS)
Pages500
Number of pages1
ISBN (electronic)978-1-6654-0996-4
Publication statusPublished - 2022
Peer-reviewedYes

Conference

Title4th IEEE International Conference on Artificial Intelligence Circuits and Systems
Abbreviated titleIEEE AICAS 2022
Conference number4
Duration13 - 15 June 2022
Website
LocationSongdo Convensia & online
CityIncheon
CountryKorea, Republic of

External IDs

Scopus 85139023616