CauSSL: Causality-inspired Semi-supervised Learning for Medical Image Segmentation

Juzheng Miao, Cheng Chen, Furui Liu, Hao Wei, Pheng-Ann HengICCV 2023 · DOI

Introduction

In the domain of medical imaging, the scarcity of expert-annotated data remains a significant hurdle. While semi-supervised learning (SSL) has emerged as a promising solution by leveraging large volumes of unlabeled data, it faces a theoretical "identity crisis" when viewed through the lens of causality. Specifically, the Principle of Independent Causal Mechanisms (ICM) suggests that if an image ($X$) causes a mask ($Y$), the distribution of $X$ should be independent of the mechanism mapping $X$ to $Y$. This implies that unlabeled data, which only informs us about the distribution of $X$, should theoretically offer no benefit for learning the prediction task.

This paper introduces CauSSL, a framework designed to bridge this gap. The authors argue that the perceived pessimism of causal theory in SSL stems from overly simplistic models that fail to account for the intermediate variables—such as pseudo-labels—utilized by modern deep learning architectures.

Theoretical Framework: Resolving the SSL Identity Crisis

The core of CauSSL lies in expanding the traditional $X \to Y$ causal model. By introducing intermediate nodes that represent the predictions ($\hat{P}$) of different network branches, the authors model how information flows from unlabeled data through one network to assist another. This shift allows the framework to reconcile SSL practices with causal principles, identifying that the success of co-training depends on maintaining "algorithmic independence" between models.

The expanded causal diagram incorporating intermediate prediction nodes to model information flow in SSL.

Methodology: Enforcing Algorithmic Independence

To operationalize this theory, CauSSL introduces a novel proxy for algorithmic independence based on matrix rank. Theoretically, two networks are independent if one cannot be easily described using the other (Kolmogorov complexity). Since this is uncomputable, the authors treat convolutional kernels as matrices. If the kernels of one network can be represented as a linear combination of the kernels in another, they are considered dependent.

The framework employs a bilevel min-max optimization strategy:

  1. Maximization Phase: The system identifies the best linear coefficients to represent one network's kernels using the other's, effectively measuring the current level of dependence.
  2. Minimization Phase: The network weights are updated to minimize this dependence while simultaneously minimizing standard segmentation losses (supervised and unsupervised).

This approach prevents the "copying" problem common in methods like Mean Teacher, where student and teacher networks eventually become identical and stop providing complementary information.

Experimental Results

The researchers evaluated CauSSL on three challenging benchmarks: ACDC (cardiac MRI), Pancreas-CT, and BraTS’19 (brain tumor MRI). The method demonstrated significant performance gains, particularly in low-data regimes:

  • ACDC: On a 10% labeled split, CauSSL improved the Dice Similarity Coefficient (DSC) by 1.01% over the standard Cross Pseudo Supervision (CPS) method.
  • Pancreas-CT: With only 6 labeled volumes, the method achieved a dramatic 4.71% DSC improvement over MC-Net+.
  • Efficiency: The training overhead was minimal, increasing from 4.40 hours to only 4.71 hours on the ACDC dataset.
Visual comparison of segmentation performance on the Pancreas-CT dataset, highlighting CauSSL's ability to produce cleaner, more accurate masks.

Qualitative analysis confirms that CauSSL-trained models produce cleaner masks with fewer false positives and superior anatomical consistency compared to baseline SSL methods.

Conclusion and Future Work

CauSSL provides a robust theoretical foundation for SSL in medical imaging by linking causal independence to network architecture. While the current implementation is optimized for convolutional layers, future work will involve adapting the independence proxy for Vision Transformers (ViTs) and refining the mathematical bounds between matrix rank and Kolmogorov complexity. Despite these areas for growth, CauSSL represents a significant step forward in making SSL both theoretically sound and practically more effective for clinical applications.

Summary updated

BibTeX
@inproceedings{miao2023caussl,
  author = {Juzheng Miao and Cheng Chen and Furui Liu and Hao Wei and Pheng-Ann Heng},
  title = {{CauSSL: Causality-inspired Semi-supervised Learning for Medical Image Segmentation}},
  booktitle = {IEEE/CVF International Conference on Computer Vision},
  year = {2023},
  doi = {10.1109/iccv51070.2023.01959},
}
Figure