Consistent Posterior Distributions under Vessel-Mixing: A Regularization for Cross-Domain Retinal Artery/Vein Classification

Chenxin Li, Yunlong Zhang, Zhehan Liang, Wenao Ma, Yue Huang, Xinghao Ding

Introduction

Retinal artery/vein (A/V) classification is a critical component in the automated screening of systemic diseases, including hypertension and diabetic retinopathy. While deep learning models have achieved high accuracy on specific datasets, their performance often degrades significantly when applied to images from different clinical settings. This phenomenon, known as domain shift, arises from variations in camera hardware, illumination, and image resolution across institutions.

Standard Unsupervised Domain Adaptation (UDA) techniques often struggle with pixel-wise tasks like vessel segmentation. Methods that align high-level features can inadvertently destroy fine structural details, leading to "negative transfer." To address this, researchers have introduced Vessel-Mixing Consistency Regularization (VM-CR), a novel approach that leverages unlabeled target data to build robust, domain-invariant models.

Methodology: Vessel-Mixing Consistency Regularization

The proposed VM-CR framework utilizes a "Mean Teacher" architecture, consisting of a Student model and a Teacher model. The Teacher's weights are updated as an exponential moving average (EMA) of the Student's weights, providing stable targets for regularization.

Overview of the VM-CR pipeline (a) and the regional Vessel-mixing augmentation strategy (b).

The core innovation is the Vessel-Mixing perturbation. Unlike global mixing strategies, this method performs regional blending:

  1. Mask Generation: A smooth binary mask ($M$) is generated using a blurred Gaussian random matrix.
  2. Regional Mixing: Two unlabeled images from the target domain are blended according to the mask $M$. This creates composite images with diverse vascular configurations, forcing the model to handle realistic structural variations.
  3. Consistency Learning: The Student model processes the mixed image, while the Teacher processes the original images. The system minimizes the discrepancy (Mean Squared Error) between the Student's prediction and the mixed predictions of the Teacher.

This approach ensures that the model's posterior distributions remain consistent under structural perturbations, effectively bridging the gap between the source and target domains without requiring additional manual labels.

Datasets and Experimental Setup

The efficacy of VM-CR was evaluated across four diverse retinal datasets, representing significant domain shifts in resolution and field-of-view.

Representative fundus images and ground truth A/V segmentations from the AV-DRIVE and HRF datasets.
  • AV-DRIVE: Contains 40 images at $584 \times 565$ resolution.
  • HRF (High Resolution Fundus): Consists of 45 images at $1200 \times 800$ resolution.
  • LES-AV: Includes 22 images at $1620 \times 1444$ resolution.
  • INSPIRE-AVR: A challenging dataset of 40 images at $2048 \times 2392$ resolution, providing only centerline labels.

Results and Discussion

VM-CR demonstrated superior performance compared to existing state-of-the-art UDA methods like AdvNet and PnP-AdaNet.

Performance Gains: In the cross-domain task from HRF to DRIVE, the baseline "Source-only" model achieved an F1 score of 79.5%. VM-CR improved this to 87.6%, nearing the supervised upper bound of 89.1%. Similarly, on the INSPIRE-AVR dataset, VM-CR reached an F1 score of 92.5%, a substantial increase from the 80.5% baseline.

Qualitative Improvements: Visual analysis indicates that VM-CR is particularly effective at classifying vessels in complex regions, such as near crossings and terminal branches. By avoiding explicit feature alignment, the method preserves the delicate graphical structure of the vascular tree, which is often lost in other adaptation frameworks.

Conclusion

Vessel-Mixing Consistency Regularization provides a powerful, label-efficient solution for cross-domain retinal A/V classification. By enforcing consistency across regionally perturbed images, the method achieves high robustness to domain shift. Future work will explore the integration of transformer-based backbones and the optimization of computational efficiency to further enhance the clinical utility of this framework.

Summary updated

Abstract

Retinal artery/vein (A/V) classification is a critical technique for diagnosing diabetes and cardiovascular diseases. Although deep learning based methods achieve impressive results in A/V classification, their performances usually degrade severely when being directly applied to another database, due to the domain shift, e.g., caused by the variations in imaging protocols. In this paper, we propose a novel vessel-mixing based consistency regularization framework, for cross-domain learning in retinal A/V classification. Specially, to alleviate the severe bias to source domain, based on the label smooth prior, the model is regularized to give consistent predictions for unlabeled target-domain inputs that are under perturbation. This consistency regularization implicitly introduces a mechanism where the model and the perturbation is opponent to each other, where the model is pushed to be robust enough to cope with the perturbation. Thus, we investigate a more difficult opponent to further inspire the robustness of model, in the scenario of retinal A/V, called vessel-mixing perturbation. Specially, it effectively disturbs the fundus images especially the vessel structures by mixing two images regionally. We conduct extensive experiments on cross-domain A/V classification using four public datasets, which are collected by diverse institutions and imaging devices. The results demonstrate that our method achieves the state-of-the-art cross-domain performance, which is also close to the upper bound obtained by fully supervised learning on target domain.
BibTeX
@inproceedings{li2021consistent,
  author = {Chenxin Li and Yunlong Zhang and Zhehan Liang and Wenao Ma and Yue Huang and Xinghao Ding},
  title = {{Consistent Posterior Distributions under Vessel-Mixing: A Regularization for Cross-Domain Retinal Artery/Vein Classification}},
  booktitle = {ICIP},
  year = {2021},
  url = {https://openreview.net/forum?id=d93rzvySOI},
}
Figure