Surgical Gesture Segmentation and Recognition
Lists
Only you see this
Abstract
Automatic surgical gesture segmentation and recognition can provide useful feedback for surgical training in robotic surgery. Most prior work in this field relies on the robot’s kinematic data. Although recent work [1,2] shows that the robot’s video data can be equally effective for surgical gesture recognition, the segmentation of the video into gestures is assumed to be known. In this paper, we propose a framework for joint segmentation and recognition of surgical gestures from kinematic and video data. Unlike prior work that relies on either frame-level kinematic cues, or segment-level kinematic or video cues, our approach exploits both cues by using a combined Markov/semi-Markov conditional random field (MsM-CRF) model. Our experiments show that the proposed model improves over a Markov or semi-Markov CRF when using video data alone, gives results that are comparable to state-of-the-art methods on kinematic data alone, and improves over state-of-the-art methods when combining kinematic and video data.
BibTeX
@inproceedings{tao2013surgical,
author = {Lingling Tao and Luca Zappella and Gregory D. Hager and René Vidal},
title = {{Surgical Gesture Segmentation and Recognition}},
booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
year = {2013},
doi = {10.1007/978-3-642-40760-4\_43},
}Loading related content...