Hybrid Spiking and Artificial Neural Networks for Radar-Based Gesture Recognition

Research output: Contribution to book/conference proceedings/anthology/reportConference contributionContributedpeer-review

Contributors

Abstract

Artificial neural networks showed astonishing results in the last decades. However, they tend to consume large amounts of energy which is problematic on edge devices such as wearables where the energy budget is limited. We propose a hybrid neural network of convolutional layers and spiking neural networks that combines the feature extraction capabilities of CNNs with the energy efficiency of SNNs for low-power radar signal processing. This approach is applied to our own radar-based gesture recognition dataset and the publicly available Soli dataset. The hybrid neural network achieves competitive or better accuracies on both datasets in comparison to similarly sized spiking and traditional networks. Experiments on the SpiNNaker 2 system show that they are a little less efficient with noisy input data compared to standard SNNs. The proposed network architecture is a straight forward approach for low-power signal processing of radar data.

Details

Original languageEnglish
Title of host publication2023 8th International Conference on Frontiers of Signal Processing, ICFSP 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages83-87
Number of pages5
ISBN (electronic)979-8-3503-0879-2
Publication statusPublished - 2023
Peer-reviewedYes

Publication series

Series2023 8th International Conference on Frontiers of Signal Processing, ICFSP 2023

Conference

Title8th International Conference on Frontiers of Signal Processing, ICFSP 2023
Duration23 - 25 October 2023
CityHybrid, Corfu
CountryGreece

Keywords

Sustainable Development Goals

Keywords

  • gesture recognition, hybrid neural networks, radar, spiking neural networks, spinnaker 2