VPBSD:Vessel-Pattern-Based Semi-Supervised Distillation for Efficient 3D Microscopic Cerebrovascular Segmentation

Xi Lin, Shixuan Zhao, Xinxu Wei, Amir Shmuel, Yongjie LiarXiv 2024 · DOI · arXiv

Introduction

Mapping the brain's vascular network, from major arteries down to microscopic capillaries, is critical for advancing our understanding of neurodegenerative diseases and stroke. However, 3D microscopic imaging of the whole brain presents significant computational challenges. Single scans can reach terabytes in size, making inference with high-capacity models prohibitive. Furthermore, the intricate nature of these structures makes manual annotation extremely labor-intensive, leading to a severe scarcity of labeled data.

To address these issues, this paper introduces the Vessel-Pattern-Based Semi-Supervised Distillation (VpbSD) framework. The goal is to develop a lightweight student model that is efficient enough for whole-brain processing while retaining the high-precision segmentation capabilities of massive, heavy-duty architectures.

Methodology

The VpbSD framework utilizes a multi-stage approach combining self-supervised learning, vector quantization, and knowledge distillation.

The Teacher and the Vessel-Pattern Codebook

The process begins with a high-capacity teacher model (Swin UNETR) pretrained on unlabeled data. The core innovation lies in the creation of a Vessel-Pattern Codebook. Inspired by Vector Quantized Variational Autoencoders (VQ-VAE), the teacher learns to map continuous vascular features into a discrete "visual vocabulary." This codebook captures the fundamental geometric patterns of various blood vessel types, providing a structured knowledge base for the student model.

Knowledge Transfer and Distillation

In the distillation stage, a lightweight "Light UNet" student model is trained to align its internal features with the teacher's discrete codebook. Because the teacher's feature space is significantly higher in dimensionality than the student's, the authors employ 1x1 convolutions for dimension alignment. This ensures that the student can effectively ingest the teacher's complex vascular knowledge.

Overview of the Knowledge Transfer and Distillation Stage, illustrating the interaction between the frozen teacher, the vessel-pattern codebook, and the lightweight student model.

Semi-Supervised Learning

To maximize the utility of limited annotated data, the framework incorporates semi-supervised learning. The student is trained simultaneously on a small set of manually labeled images and a larger set of unlabeled images using "pseudo-labels" generated by the teacher model. This dual-supervision approach helps the student generalize better to the complex variations found in whole-brain scans.

Experimental Results

The VpbSD pipeline was evaluated using the VesSep2020 dataset, which contains light-sheet microscopy images of mouse brains across four different strains. Despite the extreme challenge of having only 11 manually annotated samples, the framework demonstrated superior performance.

Quantitative and Qualitative Performance

The VpbSD student model achieved a Dice Similarity Coefficient (DSC) of 0.852, nearly matching the performance of the heavy Swin UNETR teacher (0.875) and significantly outperforming the baseline Light UNet (0.823). Notably, the HD95 (Hausdorff Distance) dropped to 1.974, indicating high precision in capturing vessel boundaries.

Quantitative comparison of VpbSD against state-of-the-art methods and qualitative segmentation results showing improved capillary detection.

Efficiency Gains

The efficiency improvements are substantial. The student model contains only 0.12 million parameters, making it nearly 500 times smaller than the teacher (63.98 million parameters). Furthermore, the inference time per 3D block was reduced to 2.49 ms, approximately 10 times faster than the Transformer-based teacher model.

Conclusion

VpbSD successfully bridges the gap between model efficiency and segmentation accuracy for large-scale 3D microscopic data. By distilling discrete "vessel-pattern" knowledge, the framework enables high-fidelity mapping of the cerebrovascular network using lightweight hardware. Future work will focus on testing the pipeline across diverse staining agents and multi-modal datasets to further validate its robustness in clinical and research settings.

Summary updated

Abstract

3D microscopic cerebrovascular images are characterized by their high resolution, presenting significant annotation challenges, large data volumes, and intricate variations in detail. Together, these factors make achieving high-quality, efficient whole-brain segmentation particularly demanding. In this paper, we propose a novel Vessel-Pattern-Based Semi-Supervised Distillation pipeline (VpbSD) to address the challenges of 3D microscopic cerebrovascular segmentation. This pipeline initially constructs a vessel-pattern codebook that captures diverse vascular structures from unlabeled data during the teacher model's pretraining phase. In the knowledge distillation stage, the codebook facilitates the transfer of rich knowledge from a heterogeneous teacher model to a student model, while the semi-supervised approach further enhances the student model's exposure to diverse learning samples. Experimental results on real-world data, including comparisons with state-of-the-art methods and ablation studies, demonstrate that our pipeline and its individual components effectively address the challenges inherent in microscopic cerebrovascular segmentation.
BibTeX
@misc{lin2024vpbsd,
  author = {Xi Lin and Shixuan Zhao and Xinxu Wei and Amir Shmuel and Yongjie Li},
  title = {{VPBSD:Vessel-Pattern-Based Semi-Supervised Distillation for Efficient 3D Microscopic Cerebrovascular Segmentation}},
  year = {2024},
  eprint = {2411.09567},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2411.09567},
}
Figure