Uncertainty-Guided Coarse-to-Fine Tumor Segmentation with Anatomy-Aware Post-Processing

Ilkin Isler, Aziz Mohaisen, Curtis Lisle, Damla Turgut, Ulaş Bağcı2025 · arXiv

Introduction

Segmenting lung tumors in computed tomography (CT) scans remains a significant challenge in medical imaging. Tumors exhibit extreme variability in size and shape, and their boundaries are frequently obscured by partial volume effects. Furthermore, aggressive tumors often invade adjacent anatomical structures, such as the chest wall or mediastinum, complicating standard segmentation approaches that rely on rigid lung masking.

Existing deep learning models face three primary hurdles: extreme class imbalance between small tumors and large CT volumes, rigid anatomical priors that may exclude invasive tumor regions, and a lack of uncertainty quantification, which limits clinical trust. This paper presents a two-stage framework designed to address these issues through coarse-to-fine refinement and anatomy-aware post-processing.

Methodology

The proposed framework utilizes a two-stage cascade pipeline to improve segmentation accuracy and reliability.

Stage 1: Coarse Localization and Anatomy-Aware Post-Processing

The first stage employs a 3D model (e.g., Swin UNETR) to process the full CT volume, acting as a surrogate for tumor localization. Rather than accepting this output as final, the system applies a "clinically informed" post-processing module:

  • Component Merging: Fragmented predictions are joined using dilation.
  • Anatomy-Aware Filtering: Instead of a binary lung mask, the system uses a nuanced rule: regions with low lung overlap are discarded unless they are in close proximity to the lung surface, allowing for the inclusion of invasive tumors.
  • Component Selection: The authors found that selecting only the largest predicted component (Top-1) significantly reduces false positives, acting as a spatial attention mechanism.
The proposed two-stage segmentation pipeline, featuring coarse localization, anatomy-aware post-processing, and fine refinement with uncertainty quantification.

Stage 2: Fine Refinement and Uncertainty Modeling

In the second stage, the model crops the CT image around the refined regions of interest (ROIs) for high-resolution segmentation. To handle boundary ambiguity, the model incorporates Monte Carlo (MC) Dropout to estimate voxel-wise uncertainty. An adaptive loss function dynamically reweights Dice and Cross-Entropy losses based on this uncertainty, forcing the network to focus on the most challenging boundary regions.

Results and Discussion

The framework was evaluated on the Orlando Health dataset and the public NSCLC-Radiomics dataset.

Performance Gains

The two-stage approach yielded substantial improvements. On the Orlando dataset, the Dice score for the Swin UNETR baseline increased from 0.4690 to 0.6447. Boundary accuracy also improved dramatically; the 95th percentile Hausdorff Distance (HD95) dropped from 187.97 mm in the full-volume baseline to 8.89 mm in the refined ROI model.

Visual comparison of segmentation results across different stages of the pipeline, including ground truth, initial predictions, post-processed results, and uncertainty maps.

The Impact of Denoising

A key finding was the strong correlation between the reduction of spurious components and overall segmentation performance (ρ = -0.83, p < 0.0001). This validates the "anatomy-aware" filtering strategy as a critical component for denoising initial predictions. The "Top-1" selection strategy proved particularly effective at removing the noise that typically inhibits high Dice scores in single-stage models.

Conclusion

By treating segmentation as a coarse-to-fine process and integrating clinical priors with uncertainty modeling, this framework significantly enhances the precision of lung tumor delineation. While the "Top-1" strategy may require further refinement to handle multifocal tumors, the current system provides a robust, interpretable tool for clinical workflows, offering both improved accuracy and valuable uncertainty heatmaps for clinician review.

Summary updated

Abstract

Reliable tumor segmentation in thoracic computed tomography (CT) remains challenging due to boundary ambiguity, class imbalance, and anatomical variability. We propose an uncertainty-guided, coarse-to-fine segmentation framework that combines full-volume tumor localization with refined region-of-interest (ROI) segmentation, enhanced by anatomically aware post-processing. The first-stage model generates a coarse prediction, followed by anatomically informed filtering based on lung overlap, proximity to lung surfaces, and component size. The resulting ROIs are segmented by a second-stage model trained with uncertainty-aware loss functions to improve accuracy and boundary calibration in ambiguous regions. Experiments on private and public datasets demonstrate improvements in Dice and Hausdorff scores, with fewer false positives and enhanced spatial interpretability. These results highlight the value of combining uncertainty modeling and anatomical priors in cascaded segmentation pipelines for robust and clinically meaningful tumor delineation. On the Orlando dataset, our framework improved Swin UNETR Dice from 0.4690 to 0.6447. Reduction in spurious components was strongly correlated with segmentation gains (HD95: ρ = −0.83, p < 0.0001), underscoring the value of anatomically informed post-processing.
BibTeX
@misc{isler2025uncertainty,
  author = {Ilkin Isler and Aziz Mohaisen and Curtis Lisle and Damla Turgut and Ulaş Bağcı},
  title = {{Uncertainty-Guided Coarse-to-Fine Tumor Segmentation with Anatomy-Aware Post-Processing}},
  year = {2025},
  eprint = {2504.12215},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2504.12215},
}
Figure