NetLfD: Network-Aware Learning From Demonstration for In-Contact Skills via Teleoperation

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

  • Basak Gulecyuz - , Technical University of Munich, TUD Dresden University of Technology (Author)
  • Vincent Von Buren - , Technical University of Munich (Author)
  • Xiao Xu - , Technical University of Munich (Author)
  • Eckehard Steinbach - , Technical University of Munich, TUD Dresden University of Technology (Author)

Abstract

When providing task demonstrations to a remote robot over the network via bilateral teleoperation, communication impairments are unavoidable, hindering the human operator from delivering high-quality demonstrations. Poor-quality demonstrations can negatively impact the robot's ability to learn and generalize. In this letter, we propose to enhance learning performance by introducing a network-aware confidence weighting strategy for remote learning from demonstration. Our approach extends the Hidden Semi-Markov Model (HSMM) and its task-parameterized version (TP-HSMM) to their confidence-weighted versions, WHSMM and WTP-HSMM. We evaluated various weight metrics that serve as teleoperation transparency measures and demonstration quality indicators under varying communication delays. We validated the proposed approach in two different in-contact tasks using data collected from 18 participants. The results show that weighting improves task performance in reproduction by up to 42% in the force precision and 63% in the success rate, demonstrating the potential of the proposed approach to enhance the effectiveness of robot learning from remote demonstrations.

Details

Original languageEnglish
Pages (from-to)6995-7002
Number of pages8
JournalIEEE Robotics and Automation Letters
Volume8
Issue number11
Publication statusPublished - 1 Nov 2023
Peer-reviewedYes