Enhancing Shared Autonomy in Teleoperation under Network Delay: Transparency- and Confidence-Aware Arbitration

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

  • Basak Gulecyuz - , Technical University of Munich, Centre for Tactile Internet with Human-in-the-Loop (CeTI) (Author)
  • Ribin Balachandran - , German Aerospace Center (DLR) (Author)
  • Michael Panzirsch - , German Aerospace Center (DLR) (Author)
  • Harsimran Singh - , German Aerospace Center (DLR), Centre for Tactile Internet with Human-in-the-Loop (CeTI) (Author)
  • Thomas Hulin - , German Aerospace Center (DLR), Centre for Tactile Internet with Human-in-the-Loop (CeTI) (Author)
  • Xiao Xu - , Technical University of Munich (Author)
  • Eckehard Steinbach - , Technical University of Munich, Centre for Tactile Internet with Human-in-the-Loop (CeTI) (Author)

Abstract

Shared autonomy bridges human expertise with machine intelligence, yet existing approaches often overlook the impact of teleoperation delays. To address this gap, we propose a novel shared autonomy approach that enables robots to gradually learn from teleoperated demonstrations while adapting to network delays. Our method improves intent prediction by accounting for delayed feedback to the human operator and adjusts the arbitration function to balance reduced human confidence due to delay with confidence in learned autonomy. To ensure system stability, which might be compromised by delay and arbitration of human and autonomy control forces, we introduce a three-port extension of the Time-Domain Passivity Approach with Energy Reflection (TDPA-ER). Experimental validation with 12 participants demonstrated improvements in intent prediction accuracy, task performance, and the quality of final learned autonomy, highlighting the potential of our approach to enhance teleoperation and learning quality in remote environments.

Details

Original languageEnglish
Pages (from-to)9654-9661
Number of pages8
JournalIEEE Robotics and Automation Letters
Volume10
Issue number10
Early online dateAug 2025
Publication statusPublished - Oct 2025
Peer-reviewedYes