Quality enhancement of compressed vibrotactile signals using recurrent neural networks and residual learning

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

  • Andreas Noll - , Technical University of Munich, TUD Dresden University of Technology (Author)
  • Ayten Gurbuz - , Technical University of Munich (Author)
  • Basak Gulecyuz - , Technical University of Munich, TUD Dresden University of Technology (Author)
  • Kai Cui - , Technical University of Munich (Author)
  • Eckehard Steinbach - , Technical University of Munich, TUD Dresden University of Technology (Author)

Abstract

We present a neural network-based compression artifact removal technique for vibrotactile signals. The proposed decoder-side quality enhancement approach is based on recurrent neural networks (RNNs) and the principle of residual learning. We use a total of 8 nonlinear RNN layers trained to first estimate the difference between the original and the compressed signal. The estimated difference signal is then added to the compressed signal, followed by further linear processing steps to construct the enhanced signal. With our approach, we are able to enhance signals at almost all compression ratios by up to 1:25 dB. For the signals in our data set, rougly 86% are enhanced in their quality. Through an ablation study, we show that every block of our network is functioning as intended and contributes to the compression artifact removal. Additionally, we show that the chosen network parameters maximize performance.

Details

Original languageEnglish
Article number9428501
Pages (from-to)316-321
Number of pages6
JournalIEEE Transactions on Haptics
Volume14
Issue number2
Publication statusPublished - 1 Apr 2021
Peer-reviewedYes

External IDs

Scopus 85105844195
PubMed 33974547

Keywords

Keywords

  • Machine learning, Quality enhancement, RNN, residual learning, Tactile signal compression