Uncertainty Awareness Enables Efficient Labeling for Cancer Subtyping in Digital Pathology

Nirhoshan Sivaroopan, Chamuditha Jayanga Galappaththige, Chalani Ekanayake, Hasindri Watawana, Ranga Rodrigo, Chamira U. S. Edussooriya, Dushan N. Wadduwage

TL;DR

By integrating Evidential Deep Learning into a self-supervised contrastive learning framework (SimCLRv2), this paper introduces an uncertainty-aware active learning strategy for digital pathology. The proposed method achieves state-of-the-art cancer subtyping performance using as little as 2-3% of expert-labeled data, drastically reducing the manual annotation bottleneck.

What Problem Does This Paper Address?

Deep learning has massive potential to streamline cancer diagnostics via digital pathology. However, training reliable models requires vast amounts of pixel-level annotations from expert pathologists—a process that is notoriously time-consuming, expensive, and prone to human variability.

While self-supervised learning (SSL) helps mitigate this by pre-training on unlabeled data, standard SSL models lack explainability and often struggle when applied to out-of-domain datasets. Active Learning (AL) introduces a human-in-the-loop approach to query only the most informative samples for labeling, but traditional AL querying strategies (like random sampling or basic entropy) often fail to select the best images or rely on computationally expensive uncertainty metrics like Monte Carlo dropout or deep ensembles.

This paper bridges the gap by embedding direct, mathematically rigorous uncertainty quantification directly into an advanced SSL pipeline to optimize active learning.

Methods

The authors propose UA-SimCLRv2 (Uncertainty-Aware SimCLRv2), a framework that combines self-supervised representation learning with Evidential Deep Learning (EDL).

  1. Self-Supervised Baseline: The architecture builds on SimCLRv2, which utilizes contrastive learning on unlabeled images, followed by supervised fine-tuning and knowledge distillation.
  2. Uncertainty Awareness: Instead of using a standard softmax layer for classification, the authors replace it with a ReLU activation layer to output a non-negative evidence vector. This vector parameterizes a Dirichlet distribution based on the Dempster-Shafer Theory of Evidence. This allows the network to model second-order probabilities and explicitly quantify epistemic uncertainty (the model's lack of knowledge) in a single forward pass.
  3. Active Learning Loop (UA-AL): The model starts by training on a tiny fraction (1%) of randomly labeled data. It then evaluates the remaining unlabeled pool, identifies the top 1% of images with the highest uncertainty scores, and requests expert labels for only those images. This process repeats iteratively up to a 10% labeling threshold.
Figure 1. The SimCLRv2 framework comprises three steps: (A1) Pre-training employs contrastive learning on unlabelled images. (A2) Supervised fine-tuning adds a classification head to the pre-trained encoder and fine-tunes using labeled images. (A3) Knowledge distil- lation involves using the fine-tuned model as a teacher network to generate pseudo labels for unlabeled images, then training a student network. (B) The proposed UA-SimCLRv2 model extends this with an additional output for the uncertainty score, enhancing model pre- diction explainability.

Datasets

The framework was evaluated on two benchmark digital pathology datasets:

  • Patch Camelyon (PCam): A binary classification dataset containing 327,680 histopathology patches extracted from lymph node sections, labeled for the presence or absence of metastatic tissue.
  • NCT-CRC-HE-100K (NCT100k): A multi-class dataset consisting of 100,000 H&E-stained histological patches from human colorectal cancer and normal tissues, annotated into nine distinct tissue classes.

Key Insights and Ideas

  • Uncertainty as a Proxy for Informative Data: The authors discovered a tight coupling between model errors and uncertainty. Plotting the histograms of uncertainty values revealed that correct predictions exhibit a left-skewed (low uncertainty) distribution, while incorrect predictions display a right-skewed (high uncertainty) distribution. This makes uncertainty an ideal metric for active learning queries.
  • Cluster Border Refinement: t-SNE visualizations demonstrated that UA-SimCLRv2 refines cluster boundaries significantly better than standard SimCLRv2. The highly uncertain samples naturally lie at the ambiguous borders between tissue classes, meaning the active learning loop targets exactly the samples needed to resolve decision boundary confusion.
t-SNE visualization showing uncertainty color-coding and cluster boundary refinement.

Key Results

  • Label Efficiency: In multi-class colorectal cancer subtyping (NCT100k), the uncertainty-aware active learning framework achieved performance parity with state-of-the-art (SOTA) models using only 2-3% of the training labels.
  • Surpassing the Baseline: When allowed just 9% of strategically selected labels, the out-domain UA-AL model achieved an accuracy of 97.01%, outperforming SOTA models (like HistoSSL-Res) trained on 100% of the dataset.
Figure 2. (A) UA-AL framework (B) Outdomain training of UA-AL outperforms random label selection, achieving comparable results to the SOTA with just 3% of labels, and surpassing the SOTA with 9% of labels.

Limitations and Future Work

Despite its success, the authors note a limitation in the ultra-low label regime: at the absolute starting point of 1% labeled data, UA-SimCLRv2 occasionally underperformed compared to standard SimCLRv2. This is likely because the model lacks sufficient initial evidence to reliably quantify its own uncertainty.

Moving forward, the authors plan to explore the dynamics of in-domain versus out-domain pre-training more thoroughly. They also aim to scale this patch-level encoder up to Whole Slide Image (WSI) classification by integrating it as a backbone for Multiple Instance Learning (MIL) frameworks.

Summary updated

Abstract

Machine-learning-assisted cancer subtyping is a promising avenue in digital pathology. Cancer subtyping models, however, require careful training using expert annotations so that they can be inferred with a degree of known certainty (or uncertainty). To this end, we introduce the concept of uncertainty awareness into a self-supervised contrastive learning model. This is achieved by computing an evidence vector at every epoch, which assesses the model's confidence in its predictions. The derived uncertainty score is then utilized as a metric to selectively label the most crucial images that require further annotation, thus iteratively refining the training process. With just 1-10% of strategically selected annotations, we attain state-of-the-art performance in cancer subtyping on benchmark datasets. Our method not only strategically guides the annotation process to minimize the need for extensive labeled datasets, but also improves the precision and efficiency of classifications. This development is particularly beneficial in settings where the availability of labeled data is limited, offering a promising direction for future research and application in digital pathology.
BibTeX
@inproceedings{sivaroopan2025uncertainty,
  author = {Nirhoshan Sivaroopan and Chamuditha Jayanga Galappaththige and Chalani Ekanayake and Hasindri Watawana and Ranga Rodrigo and Chamira U. S. Edussooriya and Dushan N. Wadduwage},
  title = {{Uncertainty Awareness Enables Efficient Labeling for Cancer Subtyping in Digital Pathology}},
  booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
  year = {2025},
  doi = {10.1109/wacv61041.2025.00067},
}
Figure