Recognition of surgical skills using hidden markov models

Research output: Contribution to book/conference proceedings/anthology/reportConference contributionContributedpeer-review

Contributors

  • Stefanie Speidel - , National Center for Tumor Diseases (Partners: UKD, MFD, HZDR, DKFZ), Karlsruhe Institute of Technology (Author)
  • Tom Zentek - , Karlsruhe Institute of Technology (Author)
  • Gunther Sudra - , Karlsruhe Institute of Technology (Author)
  • Tobias Gehrig - , Heidelberg University  (Author)
  • Beat Peter Müller-Stich - , Heidelberg University  (Author)
  • Carsten Gutt - , Heidelberg University  (Author)
  • Rüdiger Dillmann - , Karlsruhe Institute of Technology (Author)

Abstract

Minimally invasive surgery is a highly complex medical discipline and can be regarded as a major breakthrough in surgical technique. A minimally invasive intervention requires enhanced motor skills to deal with difficulties like the complex hand-eye coordination and restricted mobility. To alleviate these constraints we propose to enhance the surgeon's capabilities by providing a context-aware assistance using augmented reality techniques. To recognize and analyze the current situation for context-aware assistance, we need intraoperative sensor data and a model of the intervention. Characteristics of a situation are the performed activity, the used instruments, the surgical objects and the anatomical structures. Important information about the surgical activity can be acquired by recognizing the surgical gesture performed. Surgical gestures in minimally invasive surgery like cutting, knot-tying or suturing are here referred to as surgical skills. We use the motion data from the endoscopic instruments to classify and analyze the performed skill and even use it for skill evaluation in a training scenario. The system uses Hidden Markov Models (HMM) to model and recognize a specific surgical skill like knot-tying or suturing with an average recognition rate of 92%.

Details

Original languageEnglish
Title of host publicationMedical Imaging 2009
Publication statusPublished - 2009
Peer-reviewedYes

Publication series

SeriesProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume7261
ISSN1605-7422

Conference

TitleMedical Imaging 2009: Biomedical Applications in Molecular, Structural, and Functional Imaging
Duration8 - 10 February 2009
CityLake Buena Vista, FL
CountryUnited States of America

External IDs

ORCID /0000-0002-4590-1908/work/163294178

Keywords

Keywords

  • Endoscopic procedures, Localization and tracking technologies, Modeling