SynCoDel: Network-Assisted Synchronization of Video and Haptic Streams for Teleoperations

Research output: Contribution to book/conference proceedings/anthology/reportConference contributionContributedpeer-review

Abstract

Teleoperation has become mainstream in several applications, such as telesurgery, manufacturing, and construction. The human operator relies on video, audio, and haptic feedback data from the remote site to adjust operations, ensuring safety and collision avoidance. These applications require real-time perception and synchronization of modalities to maintain a high quality of experience, which presents a significant challenge. Human sensitivities are different among modalities, while communication networks rely on statistical multiplexing to maximize bandwidth utilization, often neglecting the specific latency requirements of each modality. We introduce SynCoDel to minimize asynchrony between video and haptic streams by considering event pairs, which are synchronized events. By prioritizing video packets within these pairs, we effectively utilize bandwidth resources initially reserved for high-priority haptic streams. Evaluation on a practical testbed with the programmable data plane and synthetic data shows that SynCoDel reduced asynchrony over half while maintaining low latency for haptic and video streams in congestion scenarios.

Details

Original languageEnglish
Title of host publication2024 IEEE 49th Conference on Local Computer Networks (LCN)
PublisherIEEE
Pages1-6
Number of pages6
ISBN (print)979-8-3503-8801-5
Publication statusPublished - 8 Oct 2024
Peer-reviewedYes

Conference

Title2024 IEEE 49th Conference on Local Computer Networks
Abbreviated titleLCN 2024
Conference number49
Duration8 - 10 October 2024
Website
LocationMercure Caen Centre Port de Plaisance Hotel
CityCaen
CountryFrance

External IDs

ORCID /0000-0001-8469-9573/work/171063462
ORCID /0000-0001-7008-1537/work/171065086
ORCID /0009-0005-7045-4096/work/171066161

Keywords

Keywords

  • Sensitivity, Bandwidth, Streaming media, Real-time systems, Haptic interfaces, Safety, Synchronization