Segmentation Ability Map: Interpret deep features for medical image segmentation

Sheng He, Yanfang Feng, Patricia Ellen Grant, Yangming Ou

Introduction

Deep Convolutional Neural Networks (CNNs), particularly architectures like U-Net, have become the gold standard for medical image segmentation. Despite their high performance, these models often function as "black boxes," providing little insight into how internal layers transform raw pixels into clinically relevant anatomical structures. Existing interpretability tools, such as Attention Maps or Class Activation Maps (CAMs), typically highlight where a network focuses its attention but fail to quantify how well those internal features actually perform the segmentation task.

This paper introduces ProtoSeg (Prototype Segmentation), a parameter-free method designed to audit the internal discriminative power of deep networks by generating a Segmentation Ability Map (SAM) and a corresponding Segmentation Ability (SA) score.

The ProtoSeg Framework

ProtoSeg is a "plug-and-play" module that can be integrated into existing pre-trained models without requiring additional parameters or training. The process involves three main steps:

  1. Prototype Extraction: For any hidden layer feature map, the method utilizes the network's final output to distinguish between "object" and "background" pixels. It then calculates a prototype (an average feature vector) for each class.
  2. Internal Segmentation: Each pixel in the hidden layer is re-classified based on its distance to these prototypes, resulting in a SAM.
  3. SA Score Calculation: By comparing the SAM to the ground truth using a Dice coefficient, the method quantifies the "segmentation power" of that specific layer or individual neuron.
The ProtoSeg framework for quantifying the discriminative power of learned deep features.

This framework can be used offline to audit models or online during training. When used online, the SA score is incorporated into the loss function, encouraging hidden layers to learn more discriminative features earlier in the network.

Key Insights: The Evolution of Segmentation Ability

The authors validated ProtoSeg across five diverse datasets, including brain tumors (BraTS), skin lesions (ISIC), and COVID-19 lung infections. Their analysis revealed several critical insights into network behavior:

  • The Transition of Ability: Segmentation ability generally increases as data moves from early to late layers. however, there is a characteristic dip in "abstract layers" (the bottleneck of a U-Net) where spatial resolution is at its lowest.
  • U-Net as a Denoise Model: Early layers are often sensitive to noise. The encoder path effectively filters this noise, while the decoder path progressively recovers the object's geometric shape.
  • Redundancy and "Inertia Units": Analysis of the final convolutional layer showed significant redundancy. Only 20% to 50% of neurons (units) possessed high SA scores. The remaining "inertia units" contribute little to the final discriminative power, suggesting potential for model pruning.
Visualizing feature maps and their corresponding segmentation maps with calculated SA scores across different layers.

Clinical Utility: Trust Without Truth

One of the most promising applications of this research is the ability to estimate segmentation quality on new images without ground-truth labels. The researchers found that the mean SA score (μ) of the final layers correlates strongly with the final Dice accuracy.

In a clinical workflow, this allows for "sample rejection." For example, on the COVID-19 dataset, rejecting the bottom 20% of images (those with the lowest mean SA scores) improved the average Dice score on the remaining test set from 0.4880 to 0.5400. This provides a reliable confidence metric, allowing systems to flag poor-quality segmentations for human review.

Conclusion and Future Work

ProtoSeg offers a robust roadmap of how a network "thinks," transforming qualitative visualization into quantitative assessment. While currently evaluated on 2D models, future work aims to extend this to 3D networks and explore using SA scores to prune redundant units for more efficient clinical deployment. By bridging the gap between performance and interpretability, ProtoSeg moves medical AI one step closer to transparent, reliable clinical integration.

Summary updated

BibTeX
@article{he2023segmentation,
  author = {Sheng He and Yanfang Feng and Patricia Ellen Grant and Yangming Ou},
  title = {{Segmentation Ability Map: Interpret deep features for medical image segmentation}},
  journal = {Medical Image Analysis},
  year = {2023},
  doi = {10.1016/j.media.2022.102726},
}
Figure