On-the-fly augmented reality for orthopedic surgery using a multimodal fiducial

Sebastian Andreß, Alex Johnson, Mathias Unberath, Alexander Winkler, Kevin Yu, Javad Fotouhi, Simon Weidert, Greg Osgood, Nassir NavabJournal of Medical Imaging 2018 · DOI

Abstract

Fluoroscopic x-ray guidance is a cornerstone for percutaneous orthopedic surgical procedures. However, two-dimensional (2-D) observations of the three-dimensional (3-D) anatomy suffer from the effects of projective simplification. Consequently, many x-ray images from various orientations need to be acquired for the surgeon to accurately assess the spatial relations between the patient's anatomy and the surgical tools. We present an on-the-fly surgical support system that provides guidance using augmented reality and can be used in quasiunprepared operating rooms. The proposed system builds upon a multimodality marker and simultaneous localization and mapping technique to cocalibrate an optical see-through head mounted display to a C-arm fluoroscopy system. Then, annotations on the 2-D x-ray images can be rendered as virtual objects in 3-D providing surgical guidance. We quantitatively evaluate the components of the proposed system and, finally, design a feasibility study on a semianthropomorphic phantom. The accuracy of our system was comparable to the traditional image-guided technique while substantially reducing the number of acquired x-ray images as well as procedure time. Our promising results encourage further research on the interaction between virtual and real objects that we believe will directly benefit the proposed method. Further, we would like to explore the capabilities of our on-the-fly augmented reality support system in a larger study directed toward common orthopedic interventions.
BibTeX
@article{andre2018fly,
  author = {Sebastian Andreß and Alex Johnson and Mathias Unberath and Alexander Winkler and Kevin Yu and Javad Fotouhi and Simon Weidert and Greg Osgood and Nassir Navab},
  title = {{On-the-fly augmented reality for orthopedic surgery using a multimodal fiducial}},
  journal = {Journal of Medical Imaging},
  year = {2018},
  doi = {10.1117/1.jmi.5.2.021209},
}

Loading related content...

Figure