Weakly-Supervised Convolutional Neural Networks for Vessel Segmentation in Cerebral Angiography

Arvind Vepa, Andrew Choi, Noor Nakhaei, Wonjun Lee, Noah Stier, Andrew Vu, Greyson Jenkins, Xiaoyan Yang, Manjot Shergill, Moira Desphy, Kevin Delao, Mia Levy, Cristopher Garduno, Lacy Nelson, Wandi Liu, Fan Hung, Fabien Scalzo

Abstract

Automated segmentation of cerebral vasculature in Digital Subtraction Angiography (DSA) is critical for stroke and aneurysm treatment but is hindered by the high cost of expert manual annotation. This paper presents a weakly-supervised framework that utilizes Active Contour Models (ACM) to generate training labels. By incorporating a human-in-the-loop selection process (HACWA), the method achieves a 100x reduction in annotation time. Experimental results demonstrate that models trained on these weak labels, supplemented by a small fraction of manual annotations, outperform human experts, achieving a DICE score of 84.0%.

Introduction

Digital Subtraction Angiography (DSA) remains the gold standard for visualizing intracranial blood vessels. However, the intricate nature of these structures makes manual segmentation extremely labor-intensive, often requiring nearly two hours per image. Standard deep learning approaches typically require large, high-quality annotated datasets, which are prohibitively expensive to produce in the medical domain. This research addresses the data labeling bottleneck by proposing a weakly-supervised pipeline that leverages automated "silver standard" labels to train high-performing convolutional neural networks (CNNs).

Methods

The proposed framework employs Active Contour Models (ACM) to generate initial vessel masks. Two primary strategies were evaluated:

  1. Fully-automated Active Contour Weak Annotations (FACWA): Labels are generated autonomously using fixed parameters.
  2. Human-in-the-loop Active Contour Weak Annotations (HACWA): The system generates multiple mask candidates using varying parameters, and a human expert selects the best version. This selection process takes approximately one minute, compared to nearly two hours for manual drawing.

The training pipeline uses a DenseNet169 encoder paired with a Feature Pyramid Network (FPN) decoder. The researchers also explored hybrid training, combining weak labels with varying percentages of manual annotations (MA) to optimize the performance-to-effort ratio.

The proposed two-stage pipeline for weak annotation and deep learning training.

Results

The framework was evaluated on a new dataset of 128 high-quality cerebral DSA images and the benchmark DRIVE retinal dataset. The results indicate that "good enough" labels can produce superior models. Specifically, the 100% HACWA + 11% MA configuration outperformed a second human annotator (82.5% vs 81.1% DICE). The peak performance (84.0% DICE) was achieved using 100% HACWA and 48% MA, significantly reducing the total human effort required.

Performance metrics and annotation time for various supervision strategies.

Discussion and Conclusion

The study demonstrates that human expertise is more efficiently utilized in a selection role rather than a generative one for medical image annotation. While active contours are sensitive to noise, the downstream CNNs effectively learn to generalize beyond the imperfections in the weak labels. Future work will focus on the robustness of this approach across diverse imaging hardware and pathologies. The release of the cerebral DSA dataset provides a valuable benchmark for the medical imaging community.

Summary updated

Abstract

Automated vessel segmentation in cerebral digital subtraction angiography (DSA) has significant clinical utility in the management of cerebrovascular diseases. Although deep learning has become the foundation for state-of-the-art image segmentation, a significant amount of labeled data is needed for training. Furthermore, due to domain differences, pre-trained networks cannot be applied to DSA data out-of-the-box. To address this, we propose a novel learning framework, which utilizes an active contour model for weak supervision and low-cost human-in-the-loop strategies to improve weak label quality. Our study produces several significant results, including state-of-the-art results for cerebral DSA vessel segmentation, which exceed human annotator quality, and an analysis of annotation cost and model performance trade-offs when utilizing weak supervision strategies. For comparison purposes, we also demonstrate our approach on the Digital Retinal Images for Vessel Extraction (DRIVE) dataset. Additionally, we will be publicly releasing code to reproduce our methodology and our dataset, the largest known high-quality annotated cerebral DSA vessel segmentation dataset.
BibTeX
@inproceedings{vepa2022weakly,
  author = {Arvind Vepa and Andrew Choi and Noor Nakhaei and Wonjun Lee and Noah Stier and Andrew Vu and Greyson Jenkins and Xiaoyan Yang and Manjot Shergill and Moira Desphy and Kevin Delao and Mia Levy and Cristopher Garduno and Lacy Nelson and Wandi Liu and Fan Hung and Fabien Scalzo},
  title = {{Weakly-Supervised Convolutional Neural Networks for Vessel Segmentation in Cerebral Angiography}},
  booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
  year = {2022},
  doi = {10.1109/wacv51458.2022.00328},
}
Figure