Collaborative and Adversarial Learning of Focused and Dispersive Representations for Semi-supervised Polyp Segmentation

Huisi Wu, Guilian Chen, Zhenkun Wen, Jing Qin

Introduction

Colorectal cancer (CRC) is a leading cause of cancer-related mortality worldwide. Early detection through polyp segmentation in colonoscopy images is a critical step in prevention and treatment. While deep learning has significantly advanced this field, most state-of-the-art models rely on fully supervised learning, requiring vast amounts of pixel-level manual annotations by medical experts. Such annotation is time-consuming, expensive, and subjective.

To address this, the authors propose a semi-supervised framework that effectively leverages a small amount of labeled data alongside a larger pool of unlabeled images. By utilizing collaborative networks and a dual-adversarial training strategy, the model achieves high accuracy while significantly reducing the need for manual labeling.

Methodology

The proposed framework is built upon a "Collaborative and Adversarial Learning" architecture designed to handle the high variability in polyp shape, size, and texture.

The overall architecture of the proposed semi-supervised polyp segmentation framework, featuring collaborative segmentation networks and dual-adversarial learning.

Collaborative Representation Learning

Instead of a single segmentation backbone, the framework employs two collaborative modules to capture different aspects of polyp morphology:

  • Focused Extraction Module (FEM): This module uses global attention and average pooling to zero in on the polyp’s primary location and spatial features.
  • Dispersive Extraction Module (DEM): This module utilizes dilated convolutions at varying rates to capture "scattered" boundary information, ensuring that the edges of the polyp are precisely defined.

A mutual consistency constraint is applied between these two networks, forcing them to "agree" on their predictions. This collaborative approach reduces the individual biases that often arise when training on limited datasets.

Dual Adversarial Learning

The framework incorporates two discriminators to maximize the utility of unlabeled data:

  1. Primary Discriminator ($D_1$): This network produces "confidence maps" for unlabeled predictions. These maps identify high-certainty regions, effectively turning noisy unlabeled data into reliable "pseudo-labels" for the segmentation networks.
  2. Auxiliary Adversarial Learning (AAL): A second discriminator ($D_2$) is used to distinguish between predictions from labeled versus unlabeled images. This encourages the model to produce high-quality results for unlabeled data that are indistinguishable from those backed by ground truth.

Experimental Results

The model was evaluated on two major benchmarks: Kvasir-SEG and CVC-Clinic DB. The results demonstrate that the proposed semi-supervised approach is highly competitive with, and sometimes superior to, fully supervised methods.

Qualitative comparison of segmentation results. (a) Original image, (b) Ground truth, (c-e) Predictions from different model configurations showing high adherence to polyp boundaries.

Key Performance Metrics

  • Data Efficiency: On the Kvasir-SEG dataset, using only 30% of the labeled data, the model achieved a Dice coefficient of 0.8095.
  • Competitive Edge: Remarkably, this semi-supervised result outperformed several fully supervised models (using 100% labels), including ResU-Net (0.7647) and U-Net++ (0.8045).
  • Robustness: The model showed a significant lead in Mean Absolute Error (MAE), indicating fewer large-scale errors in polyp estimation compared to existing semi-supervised methods like Hung’s method.

Conclusion

This research presents a robust semi-supervised framework for polyp segmentation that balances global localization with local boundary precision. By integrating collaborative feature extraction with dual-adversarial learning, the model achieves state-of-the-art performance with minimal labeled data. Future work will focus on extending this framework to video data to leverage temporal consistency for real-time clinical applications.

Summary updated

Abstract

Automatic polyp segmentation from colonoscopy images is an essential step in computer aided diagnosis for colorectal cancer. Most of polyp segmentation methods reported in recent years are based on fully supervised deep learning. However, annotation for polyp images by physicians during the diagnosis is time-consuming and costly. In this paper, we present a novel semi-supervised polyp segmentation via collaborative and adversarial learning of focused and dispersive representations learning model, where focused and dispersive extraction module are used to deal with the diversity of location and shape of polyps. In addition, confidence maps produced by a discriminator in an adversarial training framework shows the effectiveness of leveraging unlabeled data and improving the performance of segmentation network. Consistent regularization is further employed to optimize the segmentation networks to strengthen the representation of the outputs of focused and dispersive extraction module. We also propose an auxiliary adversarial learning method to better leverage unlabeled examples to further improve semantic segmentation accuracy. We conduct extensive experiments on two famous polyp datasets: Kvasir-SEG and CVC-Clinic DB. Experimental results demonstrate the effectiveness of the proposed model, consistently outperforming state-of-the-art semi-supervised segmentation models based on adversarial training and even some advanced fully supervised models.
BibTeX
@inproceedings{wu2021collaborative,
  author = {Huisi Wu and Guilian Chen and Zhenkun Wen and Jing Qin},
  title = {{Collaborative and Adversarial Learning of Focused and Dispersive Representations for Semi-supervised Polyp Segmentation}},
  booktitle = {IEEE/CVF International Conference on Computer Vision},
  year = {2021},
  doi = {10.1109/iccv48922.2021.00347},
}
Figure