Recognition of risk situations based on endoscopie instrument tracking and knowledge based situation modeling

Research output: Contribution to book/conference proceedings/anthology/reportConference contributionContributedpeer-review

Contributors

  • Stefanie Speidel - , National Center for Tumor Diseases (Partners: UKD, MFD, HZDR, DKFZ), Karlsruhe Institute of Technology (Author)
  • Gunther Sudra - , Karlsruhe Institute of Technology (Author)
  • Julien Senemaud - , Karlsruhe Institute of Technology (Author)
  • Maximilian Drentschew - , Karlsruhe Institute of Technology (Author)
  • Beat Peter Müller-Stich - , Heidelberg University  (Author)
  • Carsten Gutt - , Heidelberg University  (Author)
  • Rüdiger Dillmann - , Karlsruhe Institute of Technology (Author)

Abstract

Minimally invasive surgery has gained significantly in importance over the last decade due to the numerous advantages on patient-side. The surgeon has to adapt special operation-techniques and deal with difficulties like the complex hand-eye coordination, limited field of view and restricted mobility. To alleviate these constraints we propose to enhance the surgeon's capabilities by providing a context-aware assistance using augmented reality (AR) techniques. In order to generate a context-aware assistance it is necessary to recognize the current state of the intervention using intraoperatively gained sensor data and a model of the surgical intervention. In this paper we present the recognition of risk situations, the system warns the surgeon if an instrument gets too close to a risk structure. The context-aware assistance system starts with an image-based analysis to retrieve information from the endoscopic images. This information is classified and a semantic description is generated. The description is used to recognize the current state and launch an appropriate AR visualization. In detail we present an automatic vision-based instrument tracking to obtain the positions of the instruments. Situation recognition is performed using a knowledge representation based on a description logic system. Two augmented reality visualization programs are realized to warn the surgeon if a risk situation occurs.

Details

Original languageEnglish
Title of host publicationMedical Imaging 2008 - Visualization, Image-Guided Procedures, and Modeling
Publication statusPublished - 2008
Peer-reviewedYes

Publication series

SeriesProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume6918
ISSN1605-7422

Conference

TitleMedical Imaging 2008 - Visualization, Image-Guided Procedures, and Modeling
Duration17 - 19 February 2008
CitySan Diego, CA
CountryUnited States of America

External IDs

ORCID /0000-0002-4590-1908/work/163294160

Keywords

Keywords

  • Endoscopic procedures, Enhanced reality, Localization & tracking technologies, Visualization