Radar-Based Gesture Recognition with Spiking Neural Networks

Research output: Contribution to book/conference proceedings/anthology/reportConference contributionContributedpeer-review

Contributors

Abstract

Spiking neural networks (SNN) are a promising approach for low-power edge AI (artificial intelligence), especially when run on dedicated neuromorphic hardware. In this work we set up a SNN in TensorFlow, directly train it in a supervised manner with backpropagation through time (BPTT) and surrogate gradients, and compare it with traditional neural networks, based on convolutional neural networks (CNN) and long-short term memory (LSTM) cells, for radar-based hand-gesture recognition. We demonstrate that a small SNN with only 30 hidden leaky integrate-and-fire (LIF) neurons and threshold encoding can achieve an accuracy of 98.1%. With the more complex adaptive LIF neuron, the activity can be reduced by up to 37.9% without significant loss in accuracy. A comparison to traditional LSTM-networks shows the superiority of the SNN in terms of accuracy and computation cost, indicating that they are a considerable alternative to LSTM-based approaches.

Details

Original languageEnglish
Title of host publication2022 7th International Conference on Frontiers of Signal Processing, ICFSP 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages40-44
Number of pages5
ISBN (electronic)978-1-6654-8158-8
Publication statusPublished - 2022
Peer-reviewedYes

Conference

Title7th International Conference on Frontiers of Signal Processing, ICFSP 2022
Duration7 - 9 September 2022
CityParis
CountryFrance

Keywords

Keywords

  • gesture recognition, radar, spiking neural networks, surrogate gradient