Recognition of risk situations based on endoscopie instrument tracking and knowledge based situation modeling

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/GutachtenBeitrag in KonferenzbandBeigetragenBegutachtung

Beitragende

  • Stefanie Speidel - , Nationales Centrum für Tumorerkrankungen (Partner: UKD, MFD, HZDR, DKFZ), Karlsruhe Institute of Technology (Autor:in)
  • Gunther Sudra - , Karlsruhe Institute of Technology (Autor:in)
  • Julien Senemaud - , Karlsruhe Institute of Technology (Autor:in)
  • Maximilian Drentschew - , Karlsruhe Institute of Technology (Autor:in)
  • Beat Peter Müller-Stich - , Universität Heidelberg (Autor:in)
  • Carsten Gutt - , Universität Heidelberg (Autor:in)
  • Rüdiger Dillmann - , Karlsruhe Institute of Technology (Autor:in)

Abstract

Minimally invasive surgery has gained significantly in importance over the last decade due to the numerous advantages on patient-side. The surgeon has to adapt special operation-techniques and deal with difficulties like the complex hand-eye coordination, limited field of view and restricted mobility. To alleviate these constraints we propose to enhance the surgeon's capabilities by providing a context-aware assistance using augmented reality (AR) techniques. In order to generate a context-aware assistance it is necessary to recognize the current state of the intervention using intraoperatively gained sensor data and a model of the surgical intervention. In this paper we present the recognition of risk situations, the system warns the surgeon if an instrument gets too close to a risk structure. The context-aware assistance system starts with an image-based analysis to retrieve information from the endoscopic images. This information is classified and a semantic description is generated. The description is used to recognize the current state and launch an appropriate AR visualization. In detail we present an automatic vision-based instrument tracking to obtain the positions of the instruments. Situation recognition is performed using a knowledge representation based on a description logic system. Two augmented reality visualization programs are realized to warn the surgeon if a risk situation occurs.

Details

OriginalspracheEnglisch
TitelMedical Imaging 2008 - Visualization, Image-Guided Procedures, and Modeling
PublikationsstatusVeröffentlicht - 2008
Peer-Review-StatusJa

Publikationsreihe

ReiheProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Band6918
ISSN1605-7422

Konferenz

TitelMedical Imaging 2008 - Visualization, Image-Guided Procedures, and Modeling
Dauer17 - 19 Februar 2008
StadtSan Diego, CA
LandUSA/Vereinigte Staaten

Externe IDs

ORCID /0000-0002-4590-1908/work/163294160

Schlagworte

Schlagwörter

  • Endoscopic procedures, Enhanced reality, Localization & tracking technologies, Visualization