Haptic Dataset Augmentation with Subjective QoE Labels using Conditional Generative Adversarial Network

Research output: Contribution to book/Conference proceedings/Anthology/Report › Conference contribution › Contributed › peer-review

Contributors

  • Zican Wang - , Technical University of Munich (Author)
  • Xiao Xu - , Technical University of Munich (Author)
  • Dong Yang - , Technical University of Munich (Author)
  • Zhenyu Wang - , Technical University of Munich (Author)
  • Sarah Shtaierman - (Author)
  • Eckehard Steinbach - , Technical University of Munich, TUD Dresden University of Technology (Author)

Abstract

This paper proposes a novel Generative Adversarial Network (GAN)-based strategy to augment subjective haptic Quality of Experience (QoE) datasets for bilateral teleoperation with haptic feedback without conducting time-consuming subjective experiments. In our previous work, we proposed a multi-assessment fusion approach to predict subjective haptic quality using a collection of objective metrics. This method requires a sufficiently large haptic dataset with QoE labels. The proposed generative approach automatically expands the existing haptic quality dataset by combining a modified conditional GAN (CGAN) and Style GAN (StyleGAN) architecture. The most important feature of our method is that it learns from the labeled training data and focuses on synthesizing signals with artifacts according to new input labels containing the QoE score, time delay, control method, and data reduction information. Extensive experiments are conducted to validate the suitability of the expanded dataset. The results show that our approach is able to generate new data, which match the label and signal distribution of the original data with categorical rank and linear correlation of over 0.85.

Details

Original languageEnglish
Title of host publication2023 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2023
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages5072-5078
Number of pages7
ISBN (electronic)978-1-6654-9190-7
Publication statusPublished - 2023
Peer-reviewedYes

Publication series

SeriesIEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
ISSN2153-0858

Conference

Title2023 IEEE/RSJ International Conference on Intelligent Robots and Systems
SubtitleThe Next Generation of Robotics
Abbreviated titleIROS 2023
Duration1 - 5 October 2023
Website
LocationHuntington Place
CityDetroit
CountryUnited States of America