PE-MT: A Perturbation-Enhanced Mean Teacher for Semi-Supervised Image Segmentation

Wen‐Quan Wang, Zhongwen Li, Xiaoyun Zhang, Gaoqiang Jiang, Yuting Wu, Shuchen Yu, Bihan Tian, Mingzhe Hu, Xiaomin Xu, Wencan Wu, Quanyong Yi, Lei WangBioengineering 2025 · DOI

TL;DR

This paper introduces PE-MT, a novel semi-supervised learning method for medical image segmentation that significantly improves performance with limited labeled data. By enhancing the "mean teacher" framework with a perturbation-enhanced EMA (pEMA) and a residual-guided uncertainty map (RUM), PE-MT effectively addresses the coupling between student and teacher models and better identifies uncertain regions, leading to more accurate segmentation.

What Problem Does This Paper Address?

Accurate segmentation of medical images is crucial for diagnosis and treatment planning, but it typically requires vast amounts of meticulously labeled data. Obtaining these labels is a labor-intensive and time-consuming process, especially for medical images that demand expert knowledge. This scarcity of labeled data severely limits the application of powerful deep learning segmentation models. Semi-supervised learning (SSL) offers a promising solution by leveraging abundant unlabeled data alongside limited labeled data. However, existing SSL methods, even advanced ones like the Uncertainty-Aware Mean Teacher (UA-MT), can suffer from issues like tight coupling between student and teacher models and insufficient handling of uncertain regions, particularly at object boundaries, leading to suboptimal segmentation accuracy.

Methods

PE-MT builds upon the UA-MT framework by introducing two key innovations:

  • Perturbation-Enhanced Exponential Moving Average (pEMA): Traditional Exponential Moving Average (EMA) in mean teacher models can lead to strong coupling between the student and teacher models, making their predictions too similar and limiting the student's learning potential. PE-MT's pEMA introduces a "perturbation-enhanced" EMA. It uses a modulus operator to add a controlled, adaptive perturbation to the teacher model's weights, derived from the difference between student and teacher weights. This helps to decouple the models, providing them with more distinct weights and improving the teacher's ability to capture diverse information, thereby enhancing the student's learning flexibility.
  • Residual-Guided Uncertainty Map (RUM): Existing uncertainty maps (like EUM in UA-MT) can sometimes struggle to precisely pinpoint high-uncertainty regions, especially at object boundaries, and may incorrectly flag background areas. The RUM employs a unique quantitative formula based on multiple forward passes of the teacher model with random perturbations. This RUM is designed to more accurately identify and highlight regions with high prediction uncertainty, particularly around object boundaries. By using this RUM to filter out these uncertain regions, the unsupervised loss computation is focused on more reliable predictions, forcing the student model to learn from more trustworthy pseudo-labels.

Datasets

The proposed PE-MT method was evaluated on two public cardiac imaging datasets:

  • Left Atrial (LA) Segmentation Challenge (LASC) dataset: Consists of 100 3D gadolinium-enhanced MRI scans.
  • Automated Cardiac Diagnosis Challenge (ACDC) dataset: Contains cardiac cine-MRI scans from 100 patients, focusing on left ventricle (LV), myocardium (Myo), and right ventricle (RV) segmentation.

Key Insights and Ideas

  • Decoupling for Better Learning: The core idea behind pEMA is that by introducing a controlled "noise" or perturbation in how the teacher model's weights are updated, it prevents the student and teacher from becoming too similar. This allows the student to learn more effectively from the teacher's refined knowledge.
  • Targeted Uncertainty: The RUM's innovation lies in its ability to precisely pinpoint where the model is uncertain, especially at the tricky boundaries of objects. This is crucial because these are often the areas where segmentation errors occur. By focusing on these specific uncertain regions, the model can learn to improve its predictions more efficiently.
  • Synergy of pEMA and RUM: The paper demonstrates that combining pEMA and RUM leads to a synergistic effect, significantly outperforming methods that use only one or neither. This suggests that addressing both model coupling and precise uncertainty localization is key to advancing semi-supervised segmentation.
  • Efficiency with Limited Labels: The results highlight that PE-MT achieves competitive performance even with as little as 5% or 10% labeled data, underscoring its effectiveness in scenarios where labeled data is scarce.

Key Results

  • LASC Dataset: PE-MT achieved an average Dice Similarity Coefficient (DSC) of 0.8341 (5% labeled data) and 0.8729 (10% labeled data), outperforming MT, UA-MT, SASSNet, and DTC.
  • ACDC Dataset: PE-MT achieved average DSCs of 0.5555 (5% labeled data) and 0.7538 (10% labeled data) across LV, Myo, and RV regions. While slightly inferior to DTC and SASSNet in some ACDC experiments, it still showed strong performance and superiority over MT and UA-MT.
  • Qualitative Improvements: Figure 4 and Figure 5 visually demonstrate PE-MT's ability to produce smoother and more accurate segmentations, particularly around object boundaries, compared to other methods. The RUM's effectiveness in highlighting and excluding problematic background regions is also visually evident.

Limitations and Future Work

The authors acknowledge several limitations:

  • Limited Backbone Architectures: The study primarily used V-Net and U-Net as backbones, which have relatively limited learning capacity compared to newer architectures like Transformers. Future work could explore integrating PE-MT with more powerful backbones.
  • Basic Data Augmentation: Only simple augmentation techniques (rotation, flip) were used. More advanced augmentation strategies could further improve robustness and accuracy, especially for images with varying modalities.
  • Small Datasets and Potential Domain Shifts: The LASC and ACDC datasets, while standard, are relatively small. The significant differences between LASC and ACDC images (potential domain shifts) might have impacted performance degradation for PE-MT compared to methods like SASSNet and DTC, which might handle these shifts better.
  • Lack of Dynamic Segmentation Validation: The method was not validated for dynamic image segmentation (e.g., video sequences), which is a crucial area for medical imaging.

Future work could focus on exploring advanced network architectures, more sophisticated data augmentation, and extending the method to dynamic segmentation tasks.

Summary updated

Abstract

The accurate segmentation of medical images is of great importance in many clinical applications and is generally achieved by training deep learning networks on a large number of labeled images. However, it is very hard to obtain enough labeled images. In this paper, we develop a novel semi-supervised segmentation method (called PE-MT) based on the uncertainty-aware mean teacher (UA-MT) framework by introducing a perturbation-enhanced exponential moving average (pEMA) and a residual-guided uncertainty map (RUM) to enhance the performance the student and teacher models. The former is used to alleviate the coupling effect between student and teacher models in the UA-MT by adding different weight perturbations to them, and the latter can accurately locate image regions with high uncertainty via a unique quantitative formula and then highlight these regions effectively in image segmentation. We evaluated the developed method by extracting four different cardiac regions from the public LASC and ACDC datasets. The experimental results showed that our developed method achieved an average Dice similarity coefficient (DSC) of 0.6252 and 0.7836 for four object regions when trained on 5% and 10% labeled images, respectively. It outperformed the UA-MT and can compete with several existing semi-supervised learning methods (e.g., SASSNet and DTC).
BibTeX
@inproceedings{wang2025pe,
  author = {Wen‐Quan Wang and Zhongwen Li and Xiaoyun Zhang and Gaoqiang Jiang and Yuting Wu and Shuchen Yu and Bihan Tian and Mingzhe Hu and Xiaomin Xu and Wencan Wu and Quanyong Yi and Lei Wang},
  title = {{PE-MT: A Perturbation-Enhanced Mean Teacher for Semi-Supervised Image Segmentation}},
  booktitle = {Bioengineering},
  year = {2025},
  doi = {10.3390/bioengineering12050453},
}
Figure