Weakly Supervised Gland Segmentation with Class Semantic Consistency and Purified Labels Filtration

Siyang Feng, Huadeng Wang, Chu Han, Zhenbing Liu, Hualong Zhang, Rushi Lan, Xipeng PanAAAI 2025 · DOI

Introduction

In the field of computational pathology, the accurate segmentation of glands is a cornerstone for grading various cancers, including colorectal and prostate adenocarcinomas. Traditionally, training deep learning models for this task has relied on "fine-grained" pixel-level masks. However, generating these annotations is a labor-intensive and costly process requiring expert pathologists. To address this, researchers are turning to Weakly Supervised Semantic Segmentation (WSSS), which utilizes only image-level labels (e.g., indicating the presence or absence of a gland) to train segmentation models.

The Challenge of Medical WSSS

Standard WSSS techniques often rely on Class Activation Maps (CAMs) to identify discriminative regions. While effective for natural images where objects like boats or trains have clear boundaries and high contrast against their backgrounds, these methods struggle with histopathological images. Glands often exhibit low contrast and ambiguous boundaries, leading standard CAMs to focus only on the most salient parts, resulting in incomplete masks and "semantic confusion" between adjacent tissues.

Comparison of segmentation results on natural images (boats, trains) versus complex histopathological gland images.

Proposed Methodology

The authors introduce a novel framework designed to overcome the limitations of traditional WSSS in medical imaging through three primary innovations:

  1. Consistency Correlation Attention (CCA): Utilizing a criss-cross attention mechanism, this module captures long-range dependencies between pixels. By ensuring that pixels belonging to the same class share similar features regardless of their spatial distance, CCA effectively sharpens the distinction between glandular and non-glandular regions.
  2. Multi-scale Pyramid Fusion Pooling (MPFP): Moving beyond Global Average Pooling (GAP), which often discards critical spatial information, MPFP aggregates features across multiple scales (2x2 to 16x16). It employs "sign-preserving convolutions" to enhance both positive and negative cues, capturing both global structure and fine-grained local details.
  3. Purified Labels Filtration (PLF): To mitigate the noise inherent in pseudo-labels generated from CAMs, the PLF module calculates a "reliability score" for each pixel. By filtering out low-confidence signals during the segmentation training phase, the model learns from a "cleaned" supervision signal.

Experimental Results and Insights

The framework was rigorously evaluated on three major datasets: ProG (Prostate Gland), GlaS (Gland Segmentation Challenge), and EBHI (Enteroscope Biopsy Histopathological Image).

The results demonstrate that the proposed method sets a new state-of-the-art for image-level WSSS. On the ProG dataset, it achieved an 87.69% mIoU, a significant 3.13% improvement over previous benchmarks. Notably, on the GlaS dataset, the model's performance (80.44% mIoU) nearly matched that of fully supervised models (80.62%), while requiring approximately 60 times less annotation effort.

Qualitative result showing the precise segmentation of gland structures using the proposed weakly supervised framework.

A key insight from the study is the model's remarkable domain adaptability. When pre-trained on one dataset and fine-tuned on another using only 1% of the target data, the model maintained high-quality results, suggesting robust generalization capabilities.

Conclusion and Future Work

This research presents a significant step toward making high-performance gland segmentation more accessible by drastically reducing annotation requirements. While the Purified Labels Filtration strategy shows limitations in single-class images, the overall framework's "plug-and-play" modules (CCA and MPFP) offer promising avenues for other weakly supervised tasks in medical imaging. Future efforts will focus on integrating these models into clinical workflows to assist pathologists in real-time cancer grading.

Summary updated

BibTeX
@inproceedings{feng2025weakly,
  author = {Siyang Feng and Huadeng Wang and Chu Han and Zhenbing Liu and Hualong Zhang and Rushi Lan and Xipeng Pan},
  title = {{Weakly Supervised Gland Segmentation with Class Semantic Consistency and Purified Labels Filtration}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2025},
  doi = {10.1609/aaai.v39i3.32306},
}
Figure