Alternate Diverse Teaching for Semi-supervised Medical Image Segmentation

Zhen Zhao, Zicheng Wang, Longyue Wang, Dian Yu, Yixuan Yuan, Luping Zhou

TL;DR

AD-MT (Alternate Diverse Teaching) is a new semi-supervised framework that tackles the "confirmation bias" problem in medical image segmentation by using two diverse teacher models. By updating these teachers in a random, alternating fashion and intelligently resolving their conflicting predictions, the method achieves state-of-the-art results on major 2D and 3D medical benchmarks with very few labeled samples.

What Problem Does This Paper Address?

Deep learning has revolutionized medical image segmentation, but it has a "data hunger" problem: training these models usually requires massive amounts of pixel-perfect labels created by expert radiologists. Semi-supervised medical image segmentation (SSMIS) aims to fix this by training models on a small set of labeled images and a much larger pool of unlabeled ones.

The current gold standard for SSMIS is the Teacher-Student framework (specifically the "Mean Teacher" approach). Here, a "Student" model learns from a "Teacher" model, which is a moving average of the Student's past weights. However, these systems often suffer from confirmation bias: if the Teacher generates an incorrect "pseudo-label" for an unlabeled image, the Student learns that error, which then feeds back into the Teacher, creating a cycle of reinforced mistakes.

Methods

The authors propose AD-MT, which introduces two novel modules to break the cycle of confirmation bias by maximizing teaching diversity.

Fig. 1: Frameworks of different SSMIS methods. Crucial distinctions arise from how the unlabeled data is leveraged. a) the plain teacher-student framework, b) a two- student co-training paradigm that enforces mutual learning, c) a two-teacher ensemble framework where two differently initialized and updated teacher models supervise the training of the student model in a average manner, d) our proposed alternate diverse mean-teacher (AD-MT) framework. Our framework involves two teacher models that are updated periodically and randomly, using complementary unlabeled data batches, distinct data augmentation strategies, and randomized switchable periods, to enlarge their disagreement. Additionally, our Conflict-Combating Module (CCM) encourages the student model to learn from the conflict predictions of the teacher models rather than dropping conflicts directly. “sg" denotes “stop gradient".

1. Random Periodic Alternate (RPA) Updating Module

Instead of one teacher, AD-MT uses two ($T_1$ and $T_2$). To ensure they don't just become identical copies of each other, the RPA module enforces diversity through three strategies:

  • Alternate Updating: In any given training iteration, only one teacher is updated via the Student's weights. This means they see different batches of data at different times.
  • Distinct Augmentations: Each teacher "specializes" in different perturbations. For example, $T_1$ might focus on color-based changes while $T_2$ uses "copy-paste" augmentations.
  • Randomized Switching: The period for which a teacher is updated is not fixed; it's randomly generated. This prevents the model from falling into a predictable pattern and reduces the risk of "over-perturbation."

2. Conflict-Combating Module (CCM)

When two teachers disagree on a pixel, most methods simply discard that data. AD-MT argues that these conflicts are actually valuable learning opportunities.

Detailed diagram of the AD-MT architecture and the Conflict-Combating Module.

The CCM uses an entropy-based ensembling strategy. It calculates the uncertainty (entropy) of both teachers' predictions. If they disagree, the module compares the teachers' combined prediction against the Student's own prediction. It then selects the most confident (lowest entropy) signal to serve as the final supervision. This allows the Student to potentially "outvote" the teachers in areas where they are confused.

Datasets

The authors evaluated AD-MT on three widely used benchmarks:

  • 2D ACDC: Cardiac MRIs with three classes (right ventricle, myocardium, left ventricle).
  • 3D LA: Left Atrium MRI scans.
  • 3D Pancreas-NIH: Abdominal CT scans, which are notoriously difficult due to the small size and high variability of the pancreas.

Testing was performed in extremely low-label regimes, such as using only 5% or 10% of the available labeled data.

Key Insights and Ideas

  • Diversity is a Defense: Confirmation bias happens because the teacher and student are too similar. By forcing two teachers to diverge through different update schedules and augmentations, the system creates a "checks and balances" mechanism.
  • Don't Waste Disagreements: Disagreements between models usually happen at the boundaries of organs or in noisy areas. By using the Student to help adjudicate these conflicts (via entropy comparison), the model learns more robust features than it would by simply ignoring the difficult pixels.
  • Efficiency Matters: Unlike "co-training" methods that require training multiple student models (doubling the computational cost), AD-MT uses non-trainable EMA teachers, making it much more efficient to run.

Key Results

AD-MT consistently outperformed existing state-of-the-art (SOTA) methods across all datasets:

  • Pancreas-NIH: With only 10% labeled data, AD-MT achieved a 6.38% improvement in Dice score over the previous SOTA (BCP).
  • 2D ACDC: With just 3 labeled instances (5%), the model reached an impressive 88.75% Dice score, outperforming methods that require complex pre-training stages.
  • 3D LA: Achieved a Dice score of 89.63% with only 4 labeled samples.
Fig. 2: We compare our proposed AD-MT with recent SSIMS methods in terms of the Dice score on 2D ACDC, 3D LA and Pancreas datasets with 3, 4, and 6 labeled instances, respectively. Our end-to-end AD-MT can consistently outperform the current state-of-the-art BCP (which requires an additional pre-training stage).

Qualitative results (visualizations) showed that AD-MT is significantly better at maintaining the connectivity of segmented regions and avoiding the "fragmented" look common in other semi-supervised methods.

Limitations and Future Work

While AD-MT shows strong performance, the paper notes a few areas for consideration:

  • Threshold Sensitivity: The performance depends on a high-confidence threshold ($\tau$). The authors found that 2D datasets prefer a higher threshold (0.95) than 3D datasets (0.75), suggesting that 3D tasks might be inherently more uncertain.
  • Future Directions: The authors suggest that exploring even more diverse ensembling strategies or integrating these alternate teaching concepts into transformer-based architectures could further push the boundaries of medical image segmentation.

Summary updated

Abstract

Semi-supervised medical image segmentation studies have shown promise in training models with limited labeled data. However, current dominant teacher-student based approaches can suffer from the confirmation bias. To address this challenge, we propose AD-MT, an alternate diverse teaching approach in a teacher-student framework. It involves a single student model and two non-trainable teacher models that are momentum-updated periodically and randomly in an alternate fashion. To mitigate the confirmation bias from the diverse supervision, the core of AD-MT lies in two proposed modules: the Random Periodic Alternate (RPA) Updating Module and the Conflict-Combating Module (CCM). The RPA schedules the alternating diverse updating process with complementary data batches, distinct data augmentation, and random switching periods to encourage diverse reasoning from different teaching perspectives. The CCM employs an entropy-based ensembling strategy to encourage the model to learn from both the consistent and conflicting predictions between the teachers. Experimental results demonstrate the effectiveness and superiority of our AD-MT on the 2D and 3D medical segmentation benchmarks across various semi-supervised settings.
BibTeX
@inproceedings{zhao2024alternate,
  author = {Zhen Zhao and Zicheng Wang and Longyue Wang and Dian Yu and Yixuan Yuan and Luping Zhou},
  title = {{Alternate Diverse Teaching for Semi-supervised Medical Image Segmentation}},
  booktitle = {European Conference on Computer Vision},
  year = {2024},
  doi = {10.1007/978-3-031-72652-1\_14},
}
Figure