Label Adversarial Learning for Skeleton-level to Pixel-level Adjustable Vessel Segmentation

Mingchao Li, Kun Huang, Zetian Zhang, Xiao Ma, Qiang ChenarXiv 2022 · DOI · arXiv

Abstract

This paper introduces Label Adversarial Learning (LAL), a novel framework designed to bridge the gap between two common but disparate styles of medical image segmentation: skeleton-level (focused on connectivity) and pixel-level (focused on vessel thickness). By introducing an adjustable adversarial weight, the researchers created a system that can "slide" between these styles, finding an optimal "middle ground" that outperforms manual human annotations in both topological accuracy and caliber clarity.

The Challenge of Vessel Segmentation

In medical imaging—specifically Optical Coherence Tomography Angiography (OCTA)—segmenting microvasculature is a significant challenge. Researchers typically rely on two types of ground-truth labels, each with inherent flaws:

  1. Skeleton-level labels: These provide a simplified map of vessel connectivity. While excellent for understanding topology, they ignore vessel diameter (caliber).
  2. Pixel-level labels: These detailed shapes represent vessel thickness but are extremely labor-intensive to produce and often contain "noise" or disconnections in dense capillary regions.
Comparison of (a) original en-face OCTA image, (b) skeleton-level labels showing clear topology but unclear caliber, and (c) pixel-level labels showing clear caliber but often unclear topology.

There is a fundamental gap between these two: one provides a clean map without thickness, while the other provides thickness at the cost of topological messiness. The authors proposed LAL to bridge this gap, enabling a model to learn an intermediate state that captures both clear topology and accurate caliber.

Methods: Label Adversarial Learning

The LAL framework consists of two primary innovations:

  • Label Adversarial Loss: Instead of training on a single label type, the model uses a weighted loss function: $$\mathcal{L} = (1 - w) \times \mathcal{L}_{sk} + w \times \mathcal{L}_p$$ The "adversarial weight" $w$ (ranging from 0 to 1) acts as a tuning knob. At $w=0$, the model behaves as a skeleton segmenter; at $w=1$, it acts as a pixel-level segmenter.

  • Embeddable Adjustment Layer: To make the network architecture itself adjustable, the authors inserted a layer that scales partial convolutional features by the weight $w$. This allows the network's internal parameters to dynamically adapt to the requested segmentation style.

During training, $w$ is randomly sampled to cover the entire spectrum. During inference, $w$ can be manually or automatically tuned to find the ideal result for a specific image.

Key Insights and Results

Finding the "Sweet Spot"

The most significant finding is that the highest quality segmentation is rarely found at the extremes ($w=0$ or $w=1$). There is a "recommended" intermediate weight (typically between $w=0.27$ and $w=0.44$) where vessels maintain clear diameters while exhibiting better connectivity than human-drawn pixel labels.

Visual results showing the transition from skeleton-level ($w=0$) to pixel-level ($w=1$) segmentation. The intermediate values provide a balance of connectivity and thickness.

Performance Metrics

  • Accuracy: On the OCTA-500 dataset, LAL-enhanced models achieved a Dice score of 93.4%, significantly outperforming traditional filters like Frangi (86.1%).
  • Noise Reduction: Using a Noise Intensity (NI) metric, the authors demonstrated that the recommended intermediate state contains far fewer isolated noise pixels than standard pixel-level segmentation.
  • Uncertainty Mapping: By observing how pixels fluctuate as $w$ changes, the framework can generate an uncertainty map to automatically identify and remove weak boundaries or noise.

Conclusion

LAL transforms vessel segmentation from a static task into a continuous, adjustable process. By treating different labeling styles as adversarial targets, the framework allows deep learning models to transcend the limitations of manual annotations, producing cleaner and more topologically sound maps of the human vasculature. Future work will focus on automating the selection of the optimal weight $w$ for various clinical pathologies.

Summary updated

Abstract

You can have your cake and eat it too. Microvessel segmentation in optical coherence tomography angiography (OCTA) images remains challenging. Skeleton-level segmentation shows clear topology but without diameter information, while pixel-level segmentation shows a clear caliber but low topology. To close this gap, we propose a novel label adversarial learning (LAL) for skeleton-level to pixel-level adjustable vessel segmentation. LAL mainly consists of two designs: a label adversarial loss and an embeddable adjustment layer. The label adversarial loss establishes an adversarial relationship between the two label supervisions, while the adjustment layer adjusts the network parameters to match the different adversarial weights. Such a design can efficiently capture the variation between the two supervisions, making the segmentation continuous and tunable. This continuous process allows us to recommend high-quality vessel segmentation with clear caliber and topology. Experimental results show that our results outperform manual annotations of current public datasets and conventional filtering effects. Furthermore, such a continuous process can also be used to generate an uncertainty map representing weak vessel boundaries and noise.
BibTeX
@misc{li2022label,
  author = {Mingchao Li and Kun Huang and Zetian Zhang and Xiao Ma and Qiang Chen},
  title = {{Label Adversarial Learning for Skeleton-level to Pixel-level Adjustable Vessel Segmentation}},
  year = {2022},
  eprint = {2205.03646},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2205.03646},
}
Figure