Adversarial Domain Adaptation for Classification of Prostate Histopathology Whole-Slide Images

Jian Ren, Ilker Hacihaliloglu, Eric A. Singer, David J. Foran, Xin Qi

TL;DR

This paper introduces a novel unsupervised domain adaptation framework to improve the accuracy of automated prostate cancer grading across different medical institutions. By combining adversarial training with a unique Siamese network architecture, the researchers successfully transferred diagnostic knowledge from labeled datasets to unlabeled ones, overcoming the "domain shift" caused by variations in tissue preparation and scanning equipment.

What Problem Does This Paper Address?

Gleason grading—the process of scoring the severity of prostate cancer from histopathology slides—is a cornerstone of diagnosis and treatment planning. While deep learning models (CNNs) have shown great promise in automating this task, they suffer from a major "brittleness" problem: a model trained on images from one hospital often performs poorly on images from another.

This drop in performance is due to domain shift. Different institutions use different microscope scanners, tissue preparation techniques, and staining procedures (like H&E staining), leading to significant variations in image appearance. Traditionally, fixing this requires pathologists to manually label thousands of new images for every new site—a process that is expensive, time-consuming, and prone to human error. The authors seek to solve this by adapting models to new sites without requiring any new manual labels.

Methods

The authors propose a two-stage unsupervised domain adaptation approach:

  1. Source Training: A modified AlexNet is trained on a labeled "source" dataset using standard supervised learning (cross-entropy loss) to classify patches into low-grade (Gleason 6-7) or high-grade (Gleason 8-10).
  2. Adversarial Adaptation: To make the model work on a new "target" domain, they employ a Generative Adversarial Network (GAN) philosophy. A discriminator network tries to guess whether a feature map came from the source or target domain. Simultaneously, the target mapping network is trained to "fool" the discriminator, effectively forcing it to learn features that are "domain-invariant" (i.e., they look the same to the model regardless of which hospital the slide came from).
  3. Siamese Regularization: This is the paper's key innovation. Since multiple patches are cropped from a single Whole-Slide Image (WSI), they should logically share the same Gleason grade. The authors use a Siamese architecture to ensure that the model treats patches from the same slide consistently. This acts as a powerful unsupervised constraint that guides the adaptation process toward more clinically relevant features.

Datasets

The study utilized two primary sources of data:

  • TCGA (The Cancer Genome Atlas): A massive public dataset containing WSIs from 32 different institutions. The authors used a subset from the University of Pittsburgh (UP) as one target domain.
  • CINJ (Cancer Institute of New Jersey): A local, independent dataset used as a second target domain to validate the model's generalizability.
  • Preprocessing: WSIs were cropped into $2048 \times 2048$ patches, and only those with sufficient tissue area were kept.

Key Insights and Ideas

  • The Power of Unlabeled Data: The core "aha moment" is that we don't need labels for the target domain to improve performance; we just need to align the distribution of the features with a domain we already understand.
  • Context Matters: Standard domain adaptation treats every image patch as an independent data point. By introducing the Siamese network, the authors leverage the spatial context inherent in pathology—the fact that patches from the same slide are biologically related—to provide a "free" supervision signal.
  • Ablation Success: The results showed that adversarial training alone helps, but adding the Siamese regularization provides a significant extra boost, proving that domain-specific structural knowledge is vital.

Key Results

The proposed method significantly outperformed baseline models (models trained on source data and applied directly to target data):

  • TCGA (w/o UP) → UP: Accuracy jumped from a baseline of 54.3% to 77.1% using the full proposed method.
  • TCGA → CINJ: Accuracy improved from 56.3% to 75.0%.
  • State-of-the-Art Comparison: On the source domain, their modified AlexNet achieved 83.0% accuracy, outperforming previous benchmarks (73.5%) in the field.
  • Qualitative Heatmaps: The authors generated Gaussian heatmaps showing that the adapted model correctly identified high-grade cancer regions that the baseline model completely missed or misclassified as low-grade.

Limitations and Future Work

While impressive, the study has a few limitations:

  • Binary Classification: The model currently classifies images into "low" vs. "high" grade. In clinical practice, distinguishing between specific Gleason scores (e.g., 3+4 vs. 4+3) is critical for treatment decisions.
  • Dataset Scale: While two datasets were used, the "target" test sets were relatively small (e.g., 83 WSIs for the CINJ experiment).
  • Future Directions: The authors suggest extending this method to a wider range of histopathology problems beyond prostate cancer and testing it on even more diverse, multi-institutional datasets to ensure clinical robustness.

Summary updated

Abstract

Automatic and accurate Gleason grading of histopathology tissue slides is crucial for prostate cancer diagnosis, treatment, and prognosis. Usually, histopathology tissue slides from different institutions show heterogeneous appearances because of different tissue preparation and staining procedures, thus the predictable model learned from one domain may not be applicable to a new domain directly. Here we propose to adopt unsupervised domain adaptation to transfer the discriminative knowledge obtained from the source domain to the target domain without requiring labeling of images at the target domain. The adaptation is achieved through adversarial training to find an invariant feature space along with the proposed Siamese architecture on the target domain to add a regularization that is appropriate for the whole-slide images. We validate the method on two prostate cancer datasets and obtain significant classification improvement of Gleason scores as compared with the baseline models.
BibTeX
@inproceedings{ren2018adversarial,
  author = {Jian Ren and Ilker Hacihaliloglu and Eric A. Singer and David J. Foran and Xin Qi},
  title = {{Adversarial Domain Adaptation for Classification of Prostate Histopathology Whole-Slide Images}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2018},
  url = {https://openreview.net/forum?id=nQfsw1hkPPV},
}

Loading related content...

Figure