Recognition of risk situations based on endoscopic instrument tracking and knowledge based situation modeling

Stefanie Speidel, Gunther Sudra, Julien Senemaud, Maximilian Drentschew, Beat Peter Müller-Stich, Carsten N. Gutt, Rüdiger DillmannMedical Imaging: Image-Guided Procedures 2008 · OpenReview

Abstract

Minimally invasive surgery has gained significantly in importance over the last decade due to the numerous advantages on patient-side. The surgeon has to adapt special operation-techniques and deal with difficulties like the complex hand-eye coordination, limited field of view and restricted mobility. To alleviate these constraints we propose to enhance the surgeon's capabilities by providing a context-aware assistance using augmented reality (AR) techniques. In order to generate a context-aware assistance it is necessary to recognize the current state of the intervention using intraoperatively gained sensor data and a model of the surgical intervention. In this paper we present the recognition of risk situations, the system warns the surgeon if an instrument gets too close to a risk structure. The context-aware assistance system starts with an image-based analysis to retrieve information from the endoscopic images. This information is classified and a semantic description is generated. The description is used to recognize the current state and launch an appropriate AR visualization. In detail we present an automatic vision-based instrument tracking to obtain the positions of the instruments. Situation recognition is performed using a knowledge representation based on a description logic system. Two augmented reality visualization programs are realized to warn the surgeon if a risk situation occurs.
BibTeX
@inproceedings{speidel2008recognition,
  author = {Stefanie Speidel and Gunther Sudra and Julien Senemaud and Maximilian Drentschew and Beat Peter Müller-Stich and Carsten N. Gutt and Rüdiger Dillmann},
  title = {{Recognition of risk situations based on endoscopic instrument tracking and knowledge based situation modeling}},
  booktitle = {Medical Imaging: Image-Guided Procedures},
  year = {2008},
  url = {https://openreview.net/forum?id=WChxkgspJQY},
}

Loading related content...

Figure