Endomersion: An Immersive Remote Guidance and Feedback System for Robot-Assisted Minimally Invasive Surgery

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Abstract

The current practice of surgical telementoring involves remote experts providing guidance via telephone or video conferences. Especially in minimally invasive surgery (MIS), this greatly limits their insight into the procedure and inhibits effective deictic referencing. To address this, we present Endomersion, an immersive remote guidance and feedback system that allows verbal and non-verbal communication through audio chat, pointing and telestration, enables remote control of the endoscope camera, and offers an immersive 3D workspace supporting remote expert’s understanding of the on-site operation. The system was developed with feedback from surgeons and tested in actual operating room settings. In this demonstration, users take over the role of the remote expert, communicating with the on-site surgeon and remotely controlling the endoscopic camera attached to a robot arm.

Details

Original languageEnglish
Title of host publicationProceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025
Place of PublicationSaint Malo, France
Pages1610-1611
Number of pages2
ISBN (electronic)979-8-3315-1484-6
Publication statusPublished - 2025
Peer-reviewedYes

Conference

Title32nd IEEE Conference on Virtual Reality and 3D User Interfaces
Abbreviated titleIEEE VR 2025
Conference number32
Duration8 - 12 March 2025
Website
LocationPalais du Grand Large
CitySaint-Malo
CountryFrance

External IDs

ORCID /0000-0003-2862-9196/work/184440583
ORCID /0000-0002-2176-876X/work/184441172
ORCID /0009-0001-1210-4080/work/184442613
ORCID /0000-0002-4590-1908/work/184442623
Scopus 105005159640

Keywords

Keywords

  • Cameras, Minimally invasive surgery;Three-dimensional displays;Robot vision systems;Mixed reality;Virtual reality;User interfaces;Cameras;Telephone sets;Remote control;Videoconferences;Mixed Reality;Remote Guidance;Telestration;Minimally Invasive Surgery, Mixed Reality, Remote Control, Remote Guidance, Robot vision systems, Telestration, Three-dimensional displays, User Interfaces, Virtual Reality, Minimally Invasive Surgery