LTSP: Long-Term Slice Propagation for Accurate Airway Segmentation

Yangqian Wu, Minghui Zhang, Weihao Yu, Hao Zheng, Jiasheng Xu, Yun Gu

Overview

Automated airway segmentation from CT scans is a critical component of modern bronchoscopic interventions. However, standard deep learning architectures often struggle with topological completeness, leading to "broken branches" in the resulting 3D maps. This paper introduces Long-Term Slice Propagation (LTSP), a two-stage framework that leverages temporal-like dependencies between image slices to reconstruct tiny peripheral bronchi and ensure a connected airway tree.

The Challenge: Topological Completeness in Bronchoscopy

In bronchoscopic navigation, a camera is guided through the lungs to reach deep lesions. This process relies on a pre-generated 3D map of the airway. If this map contains "breakages"—where a continuous branch is segmented as disconnected segments—navigation software cannot calculate a valid path to the destination.

The impact of airway segmentation errors on bronchoscopic intervention. (a) shows the navigation principle, while (b) and (c) illustrate how leakages and breakages disrupt the procedure.

Two primary factors contribute to these breakages:

  1. Intensity Variance: While the trachea is highly visible, peripheral bronchi are small and low-contrast, often blending into surrounding lung tissue.
  2. The "Vanishing" Problem: Standard architectures like U-Net use down-sampling (pooling) operations. Small bronchi, often only 2-5 pixels wide, can be lost during this compression and fail to reappear in the final segmentation.

Methodology: The LTSP Framework

To address these issues, the authors propose a two-stage end-to-end framework that treats the 3D volume as a sequence of slices, emphasizing structural continuity.

The two-stage LTSP framework architecture, featuring a coarse segmentation stage followed by the Long-Term Slice Propagation (LTSP) refinement module.

Stage 1: Coarse Segmentation

The first stage employs a 3D U-Net backbone to generate an initial feature map. While this captures the overall structure, it typically suffers from the "broken branch" problem in the finer peripheral regions.

Stage 2: LTSP Refinement

The core innovation is the Long-Term Slice Propagation (LTSP) module. Inspired by Long Short-Term Memory (LSTM) networks, the LTSP cell uses a gating mechanism (input, forget, and output gates) to manage structural information across slices.

  • Long-Term Connectivity: Unlike previous methods that only consider immediate neighbors, LTSP propagates features across multiple slices (e.g., $i-1$ and $i-2$). This allows the model to "bridge" gaps where the airway signal is weak or noisy.
  • Fine Decoding: The refined features are processed by a fine decoder to produce the final, topologically consistent segmentation.

Key Insights

  • Continuity as a Prior: By treating the 3D scan as a sequence, the model encodes the physical reality that airways are continuous tubes. If a branch is present in surrounding slices, the model is biased toward maintaining it in the current slice, even if local pixel intensity is low.
  • Overcoming Pooling Loss: The LTSP module acts during the reconstruction phase, using "memory" from adjacent slices to recover fine details lost during the initial encoder's down-sampling.
  • Dense Propagation: The study found that "dense" propagation (looking back multiple slices) provides a larger receptive field along the Z-axis, which is significantly more effective at maintaining topology than simple linear propagation.

Results and Performance

The LTSP framework was evaluated on 70 clinical chest CT scans and compared against state-of-the-art methods, including GNN-based and radial distance loss models.

  • Branch Detection (BD): LTSP achieved 90.83%, a significant improvement over competing models.
  • Tree-length Detection (TD): The model reached 87.59%, demonstrating superior ability to capture the full extent of the airway tree.
  • Dice Coefficient (DSC): Despite the focus on connectivity, the model maintained high overlap accuracy at 92.95%.

Qualitative analysis confirms that LTSP effectively fills gaps where other models fail, resulting in a more complete and navigable airway map.

Conclusion and Future Directions

LTSP represents a significant step forward in automated airway segmentation by formalizing structural continuity within the network architecture. While the current model uses a specific propagation direction, future work could explore bi-directional propagation to capture context from both directions simultaneously. Additionally, testing on larger, multi-center datasets will be essential to validate robustness across different scanner types and clinical pathologies.

Summary updated

Abstract

Purpose: Bronchoscopic intervention is a widely-used clinical technique for pulmonary diseases, which requires an accurate and topological complete airway map for its localization and guidance. The airway map could be extracted from chest computed tomography (CT) scans automatically by airway segmentation methods. Due to the complex tree-like structure of the airway, preserving its topology completeness while maintaining the segmentation accuracy is a challenging task. Methods: In this paper, a long-term slice propagation (LTSP) method is proposed for accurate airway segmentation from pathological CT scans. We also design a two-stage end-to-end segmentation framework utilizing the LTSP method in the decoding process. Stage 1 is used to generate a coarse feature map by an encoder-decoder architecture. Stage 2 is to adopt the proposed LTSP method for exploiting the continuity information and enhancing the weak airway features in the coarse feature map. The final segmentation result is predicted from the refined feature map. Results: Extensive experiments were conducted to evaluate the performance of the proposed method on 70 clinical CT scans. The results demonstrate the considerable improvements of the proposed method compared to some state-of-the-art methods as most breakages are eliminated and more tiny bronchi are detected. The ablation studies further confirm the effectiveness of the constituents of the proposed method. Conclusion: Slice continuity information is beneficial to accurate airway segmentation. Furthermore, by propagating the long-term slice feature, the airway topology connectivity is preserved with overall segmentation accuracy maintained.
BibTeX
@article{wu2022ltsp,
  author = {Yangqian Wu and Minghui Zhang and Weihao Yu and Hao Zheng and Jiasheng Xu and Yun Gu},
  title = {{LTSP: Long-Term Slice Propagation for Accurate Airway Segmentation}},
  journal = {Int. J. Comput. Assist. Radiol. Surg.},
  year = {2022},
  doi = {10.1007/s11548-022-02582-7},
}
Figure