Trackerless surgical image-guided system design using an interactive extension of 3D Slicer

Xiaochen Yang, Reid C. Thompson, Rohan C. Vijayan, Ma Luo, Logan W. Clements, Benoît M. Dawant, Michael I. Miga2018 · DOI

TL;DR

This paper introduces a novel "trackerless" surgical guidance system that integrates craniotomy planning and execution within the 3D Slicer platform. By leveraging a virtual stylus and a 3D textured point cloud of the patient's head, the system aims to eliminate the need for expensive and cumbersome optical tracking hardware, offering a simpler and more cost-effective solution for neurosurgical procedures.

What Problem Does This Paper Address?

Current image-guided surgery (IGS) systems for procedures like craniotomies heavily rely on optical tracking technology. These systems use cameras and markers to precisely locate surgical instruments and the patient in the operating room (OR). While effective, this setup is expensive, requires dedicated equipment, and often necessitates planning to occur at the time of surgery due to the need for real-time tracking. The authors aim to overcome these limitations by developing a "trackerless" approach that simplifies the process, reduces costs, and potentially allows for more flexible planning.

Methods

The core of this work is an interactive extension of the open-source 3D Slicer platform. The system incorporates several key components:

  • Virtual Stylus: A mouse-driven virtual stylus allows neurosurgeons to navigate patient imaging data (MRI) and interact with a 3D model of the patient's head. This mimics the feel of a physical stylus used in conventional IGS but without the need for tracking.
  • Interactive Planning Environment: The system provides a user-friendly interface for planning neurosurgical procedures. It seamlessly imports pre-operative data and allows for visualization of the patient's anatomy.
  • Physical-to-Virtual Registration (Trackerless): Instead of relying on optical tracking to align the physical patient with the virtual model, this system uses a 3D textured point cloud (3DTPC) of the patient's head. This texture serves as a physical reference.
  • Craniotomy Designation: The system facilitates the designation of the craniotomy by allowing surgeons to mark tumor boundaries on the 3D model, guided by MR images. This virtual plan can then be translated to the physical head using the 3DTPC as a reference.
  • 3D Textured Point Cloud (3DTPC): This is a key innovation. A textured pattern is applied to the patient's head before imaging. After acquiring a 3D textured point cloud of the head, it's registered to the MR images. This texture then acts as the sole physical reference for guiding the surgeon in the OR, eliminating the need for optical trackers.

Datasets

The experiments were conducted using imaging data from four clinical cases at Vanderbilt University Medical Center (VUMC). These cases involved different tumor sizes and locations. The authors also utilized a head-shaped phantom for some experimental setups. No new benchmarks were introduced; rather, the system was compared against the conventional approach using existing clinical data and a mock patient setup.

Key Insights and Ideas

  • The Power of Texture as a Trackerless Reference: The most significant insight is the successful demonstration that a 3D textured point cloud of the patient's head can serve as a reliable physical reference for surgical guidance, completely replacing optical tracking systems. This simplifies the OR setup and reduces costs.
  • Seamless Integration with 3D Slicer: Leveraging the well-established 3D Slicer platform as a base for developing advanced surgical guidance features significantly shortens the development cycle and makes the system accessible to researchers and clinicians.
  • Virtual Planning Translates to Physical Execution: The study shows that a craniotomy planned virtually using the system can be accurately reproduced on a physical mock patient head using the textured reference, highlighting the fidelity of the translation from virtual to physical space.
  • Potential for Cost-Effectiveness and Simplicity: By removing the need for expensive optical tracking hardware, this approach offers a more cost-efficient and simpler solution for image-guided surgery.

Key Results

The paper reports promising results from experiments conducted with an experienced neurosurgeon on four mock surgical cases.

  • High Fidelity: Figure 7 demonstrates a good agreement between the virtual craniotomy plan and the physical craniotomy designation using the trackerless approach, both in terms of centroid difference (average difference of ~15-20 mm across cases) and area percent difference (average difference of ~20-40% across cases).
  • Comparison to Conventional: While the novel approach showed good fidelity to itself (virtual vs. physical), the craniotomy areas planned using the conventional method were consistently larger than those planned with the novel system (ranging from 14% to 453% larger for cases A, B, C, and D, respectively). This difference in area is noted as "vexing" and warrants further investigation.
  • Qualitative Assessment: The neurosurgeon found the planning system to be simple, cost-efficient, and reliable. The textured pattern provided a sufficient physical reference for reproducing the virtual craniotomy.

Limitations and Future Work

  • Craniotomy Area Discrepancy: The most significant limitation acknowledged is the consistent difference in the planned craniotomy area between the novel trackerless approach and the conventional method. The authors suggest this might be due to changes in the surgeon's approach over time or other factors, and it warrants further study.
  • Time Between Experiments: The authors note that the experiments for the conventional approach were conducted approximately one year prior to the novel method's experiments. They plan to repeat experiments with both methods being compared with less time between them to ensure a more direct comparison.
  • Further Validation: The paper suggests that combining this trackerless planning and delivery approach with their previous work on cortical surface registration and deformation tracking could lead to a truly integrated and nimble vision-based guidance platform. Future work will focus on improving the fidelity of the analysis through more direct comparisons and potentially exploring other texture-based registration methods.

Summary updated

Abstract

Conventional optical tracking systems use cameras sensitive to near-infra-red (NIR) light detecting cameras and passively/actively NIR-illuminated markers to localize instrumentation and the patient in the operating room (OR) physical space. This technology is widely-used within the neurosurgical theatre and is a staple in the standard of care in craniotomy planning. To accomplish, planning is largely conducted at the time of the procedure with the patient in a fixed OR head presentation orientation. In the work presented herein, we propose a framework to achieve this in the OR that is free of conventional tracking technology, i.e. a trackerless approach. Briefly, we are investigating a collaborative extension of 3D slicer that combines surgical planning and craniotomy designation in a novel manner. While taking advantage of the well-developed 3D slicer platform, we implement advanced features to aid the neurosurgeon in planning the location of the anticipated craniotomy relative to the preoperatively imaged tumor in a physical-to-virtual setup, and then subsequently aid the true physical procedure by correlating that physical-to-virtual plan with a novel intraoperative MR-to-physical registered field-of-view display. These steps are done such that the craniotomy can be designated without use of a conventional optical tracking technology. To test this novel approach, an experienced neurosurgeon performed experiments on four different mock surgical cases using our module as well as the conventional procedure for comparison. The results suggest that our planning system provides a simple, cost-efficient, and reliable solution for surgical planning and delivery without the use of conventional tracking technologies. We hypothesize that the combination of this early-stage craniotomy planning and delivery approach, and our past developments in cortical surface registration and deformation tracking using stereo-pair data from the surgical microscope may provide a fundamental new realization of an integrated trackerless surgical guidance platform.
BibTeX
@misc{yang2018trackerless,
  author = {Xiaochen Yang and Reid C. Thompson and Rohan C. Vijayan and Ma Luo and Logan W. Clements and Benoît M. Dawant and Michael I. Miga},
  title = {{Trackerless surgical image-guided system design using an interactive extension of 3D Slicer}},
  year = {2018},
  doi = {10.1117/12.2295229},
}
Figure