POPCORN: Progressive Pseudo-Labeling with Consistency Regularization and Neighboring

Reda Abdellah Kamraoui, Vinh-Thong Ta, Nicolas Papadakis, Fanny Compaire, José V. Manjón, Pierrick Coupé

In the world of medical AI, we face a constant paradox: we have mountains of raw data (like MRI scans) but very few "ground truth" labels because expert neuroradiologists are busy and expensive. Semi-supervised learning (SSL) aims to bridge this gap by using a small set of labeled data to "teach" the model how to learn from the unlabeled pile.

However, existing SSL methods often stumble. Some rely on "pseudo-labeling" (the model labels the data itself), which can lead to a "confirmation bias" loop where the model reinforces its own mistakes. Others use "consistency regularization," which can be too simplistic for complex tasks like segmenting brain lesions.

A new paper titled POPCORN (Progressive Pseudo-labeling with COnsistency Regularization and Neighboring) proposes a clever way to combine these two approaches into a more robust, curriculum-based framework.

TL;DR

POPCORN is a semi-supervised framework for medical image segmentation that uses a proximity graph in the model's latent space to select the "easiest" unlabeled samples first. By combining this progressive selection with a novel consistency loss at the network's bottleneck, it achieves state-of-the-art results in Multiple Sclerosis (MS) lesion segmentation while significantly reducing error propagation.

What Problem Does This Paper Address?

The authors target two main hurdles in medical image segmentation:

  1. Data Scarcity: Expert annotations are rare.
  2. Domain Shift: A model trained on data from one hospital often fails when shown images from a different scanner or protocol.

Standard SSL techniques like Pseudo-Labeling (PL) often fail because they try to label everything at once. If the model is uncertain, it creates "noisy" labels, and training on those noisy labels makes the model even worse—a vicious cycle known as confirmation bias. Meanwhile, Consistency Regularization (CR) usually forces the model to give the same output for the same image under different "jitters" (like rotation), but this doesn't necessarily help the model understand the underlying features of the anatomy.

Methods

The POPCORN framework introduces three key innovations:

  1. Bottleneck Consistency Regularization: Instead of just looking at the final output, POPCORN applies a consistency loss at the "bottleneck" (the most compressed part of a U-Net). It forces the model to ensure that images with similar segmentations have similar latent feature representations.
  2. Proximity Graph Selection: This is the "Neighboring" part of the name. The model calculates the Euclidean distance between labeled and unlabeled samples in the latent space. It builds a graph to identify which unlabeled images are "closest" (most similar) to the ones it already knows how to segment.
  3. Progressive Pseudo-labeling: Borrowing from "curriculum learning," the model doesn't label all 2,901 unlabeled images at once. It picks the $K$ most similar neighbors, generates pseudo-labels for them, adds them to the training set, and retrains. It repeats this cycle until all data is integrated, effectively learning from the "easiest" cases before tackling the "hardest" ones.

Datasets

The authors evaluated POPCORN on a challenging Multiple Sclerosis (MS) lesion segmentation task:

  • Labeled Data: The ISBI training dataset (21 longitudinal images from 5 subjects). This is a very small "seed" set.
  • Unlabeled Data: A massive collection of 2,901 FLAIR MRI scans from diverse sources, manufacturers, and field strengths (1.5T and 3T).
  • Testing Data: A separate, diverse dataset of 43 subjects to test how well the model generalizes to unseen scanners and protocols.

Key Insights and Ideas

  • Latent Space is a Better Filter: Using the bottleneck features to select data is more robust than using simple "confidence scores." If an unlabeled image "looks" like a labeled one in the model's internal representation, the model is more likely to produce a reliable pseudo-label for it.
  • The "Hybrid" Loss: The total loss function balances standard segmentation loss with a consistency term that uses a distance-similarity product. This ensures that the latent space remains organized and meaningful throughout the training process.
  • Breaking the Bias Loop: By selecting data progressively via the proximity graph, the authors show they can mitigate confirmation bias. The model builds a solid foundation on "easy" neighbors before moving into the more ambiguous regions of the data distribution.

Key Results

POPCORN outperformed several state-of-the-art SSL strategies:

  • Dice Score: Achieved 73.09%, significantly higher than the baseline (64.41%) and competing SSL methods like Uncertainty-guided PL (68.31%) and Multi-task SSL (67.23%).
  • Ablation Success: The authors proved that both the consistency regularization and the proximity graph are essential. Removing the proximity graph (i.e., picking unlabeled samples at random) dropped the Dice score by 5%.
  • Qualitative Balance: Visually, POPCORN showed a superior balance between sensitivity (finding small lesions) and precision (avoiding false positives), whereas other methods tended to over-segment or miss lesions entirely in diverse testing data.

Limitations and Future Work

While impressive, the paper notes a few areas for growth:

  • Computational Cost: Because the method is iterative (train, select, retrain), it is more computationally expensive than "one-shot" SSL methods.
  • Hyperparameter Tuning: Parameters like the number of neighbors ($p$) and the number of samples per step ($K$) were chosen empirically. Automating this selection could make the framework more "plug-and-play."
  • Task Generalization: The study focused on MS lesions; future work could explore if this "neighboring" approach works as well for other tasks, like organ segmentation or tumor detection in different modalities (CT, Ultrasound).

Reference: Kamraoui, R. A., et al. (2021). POPCORN: Progressive Pseudo-labeling with Consistency Regularization and Neighboring. arXiv:2109.06361v1 [cs.CV].

Summary updated

Abstract

Semi-supervised learning (SSL) uses unlabeled data to compensate for the scarcity of annotated images and the lack of method generalization to unseen domains, two usual problems in medical segmentation tasks. In this work, we propose POPCORN, a novel method combining consistency regularization and pseudo-labeling designed for image segmentation. The proposed framework uses high-level regularization to constrain our segmentation model to use similar latent features for images with similar segmentations. POPCORN estimates a proximity graph to select data from easiest ones to more difficult ones, in order to ensure accurate pseudo-labeling and to limit confirmation bias. Applied to multiple sclerosis lesion segmentation, our method demonstrates competitive results compared to other state-of-the-art SSL strategies.
BibTeX
@inproceedings{kamraoui2021popcorn,
  author = {Reda Abdellah Kamraoui and Vinh-Thong Ta and Nicolas Papadakis and Fanny Compaire and José V. Manjón and Pierrick Coupé},
  title = {{POPCORN: Progressive Pseudo-Labeling with Consistency Regularization and Neighboring}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2021},
  url = {https://openreview.net/forum?id=f5PsBk4Cdu},
}

Loading related content...

Figure