Real-time guidewire tracking and segmentation in intraoperative x-ray

Baochang Zhang, Mai Bui, Cheng Wang, Felix Bourier, Heribert Schunkert, Nassir NavabarXiv 2024 · DOI · arXiv

Abstract

Guidewire tracking and segmentation are critical for navigating endovascular procedures, yet they remain challenging due to low contrast, anatomical noise, and real-time constraints. This paper presents a two-stage deep learning framework that achieves state-of-the-art performance. The first stage utilizes a spatiotemporally refined YOLOv5 detector to localize the guidewire, while the second stage employs a novel "HessianNet" for precise segmentation. By incorporating a physics-informed Hessian-based enhancement layer and a dual self-attention module, the system achieves a Dice score of 0.8990 and a processing speed of 35 FPS, enabling real-time surgical assistance and potential robotic integration.

Introduction

During endovascular interventions such as stenting or ablation, clinicians must navigate thin, flexible guidewires through complex vasculature under X-ray fluoroscopy. This task is hindered by several factors: the wires are extremely thin with low contrast, anatomical structures like ribs can mimic their appearance, and the wire occupies only a tiny fraction of the image pixels (extreme class imbalance). Furthermore, any automated system must operate in real-time (at least 25-30 FPS) to be clinically viable.

Methodology

The proposed framework addresses these challenges through a hierarchical approach consisting of localization followed by fine-grained segmentation.

Guidewire Localization and Refinement

The system first employs a YOLOv5s detector to identify a bounding box around the guidewire. To mitigate false positives caused by static artifacts or noise, a spatiotemporal refinement module is introduced. This module analyzes three consecutive frames to ensure that detected motion is physically consistent with a moving guidewire, effectively reducing false positives to zero in experimental trials.

HessianNet Segmentation

Once localized, the guidewire is segmented within the cropped region using HessianNet. This network introduces two primary innovations:

  1. Hessian-based Enhancement Layer: Traditional Hessian-based filters are reformulated as trainable neural network layers. This allows the model to leverage geometric priors for tube-like structures while remaining adaptive to data.
  2. Dual Self-Attention Module: To capture long-range spatial dependencies efficiently, the network uses a dimensionality-reduced attention mechanism via max-pooling.
Overview of the proposed two-stage framework, showing the detection stage with YOLOv5s and the segmentation stage with HessianNet.

Experimental Results

The framework was evaluated on a clinical dataset of 102 X-ray sequences (5,238 images) from 21 patients. Data augmentation, including elastic deformations and synthetic image generation, was used to enhance robustness.

Performance and Robustness

HessianNet achieved a Dice score of 0.8990, significantly outperforming baseline models such as U-Net and ResUnet. Qualitative results demonstrate that HessianNet maintains high continuity in segmented wires even in regions of low contrast where other models fail.

Qualitative comparison of segmentation results across different models. HessianNet shows superior continuity and accuracy compared to baselines like U-Net and CSNet.

Real-time Capability

The entire pipeline processes images at approximately 35 FPS on an NVIDIA Quadro RTX 6000. This speed exceeds the standard fluoroscopy frame rate, making it suitable for live intraoperative use.

Discussion and Conclusion

By combining physics-informed layers with modern deep learning architectures, this work provides a robust solution for real-time guidewire tracking. The two-stage approach effectively handles class imbalance and reduces computational overhead. While currently optimized for single-wire scenarios, this framework establishes a foundation for future developments in multi-wire tracking and autonomous robotic surgery.

Summary updated

Abstract

During endovascular interventions, physicians have to perform accurate and immediate operations based on the available real-time information, such as the shape and position of guidewires observed on the fluoroscopic images, haptic information and the patients' physiological signals. For this purpose, real-time and accurate guidewire segmentation and tracking can enhance the visualization of guidewires and provide visual feedback for physicians during the intervention as well as for robot-assisted interventions. Nevertheless, this task often comes with the challenge of elongated deformable structures that present themselves with low contrast in the noisy fluoroscopic image sequences. To address these issues, a two-stage deep learning framework for real-time guidewire segmentation and tracking is proposed. In the first stage, a Yolov5s detector is trained, using the original X-ray images as well as synthetic ones, which is employed to output the bounding boxes of possible target guidewires. More importantly, a refinement module based on spatiotemporal constraints is incorporated to robustly localize the guidewire and remove false detections. In the second stage, a novel and efficient network is proposed to segment the guidewire in each detected bounding box. The network contains two major modules, namely a hessian-based enhancement embedding module and a dual self-attention module. Quantitative and qualitative evaluations on clinical intra-operative images demonstrate that the proposed approach significantly outperforms our baselines as well as the current state of the art and, in comparison, shows higher robustness to low quality images.
BibTeX
@misc{zhang2024real,
  author = {Baochang Zhang and Mai Bui and Cheng Wang and Felix Bourier and Heribert Schunkert and Nassir Navab},
  title = {{Real-time guidewire tracking and segmentation in intraoperative x-ray}},
  year = {2024},
  eprint = {2404.08805},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2404.08805},
}
Figure