Self-supervised deep learning for pan-cancer mutation prediction from histopathology

Oliver Lester Saldanha, Chiara Maria Lavinia Loeffler, Jan Niehues, Marko van Treeck, Tobias Paul Seraphin, Katherine Hewitt, Didem Çifçi, Gregory Patrick Veldhuizen, Siddhi Ramesh, Alexander T. Pearson, Jakob Nikolas KatherbioRxiv 2022 · DOI

TL;DR

This paper introduces a self-supervised deep learning approach to predict genetic mutations directly from histopathology images across multiple cancer types. By training on one large dataset (TCGA) and validating on another (CPTAC), they demonstrate robust, generalizable prediction of genetic alterations, paving the way for AI-assisted pre-screening of patients for genetic testing.

What Problem Does This Paper Address?

Understanding the genetic underpinnings of cancer is crucial for diagnosis, prognosis, and treatment. Histopathology, the microscopic examination of tissue, offers a rich source of information about tumor morphology, which is known to be influenced by the tumor's genetic makeup. While deep learning (DL) has shown promise in predicting genetic alterations from histology images, a major challenge has been the lack of external validation. Previous studies often relied on single, large datasets, making their findings potentially biased by dataset-specific artifacts (batch effects) and limiting their applicability to new, unseen data. This paper addresses this gap by developing and validating a DL pipeline that can generalize across different datasets and tumor types, moving closer to real-world clinical utility.

Methods

The core of this work is a deep learning pipeline that leverages two key techniques:

  • Self-supervised Feature Extraction: Instead of relying on labeled data for every mutation, the model is pre-trained using self-supervised learning. This allows it to learn generalizable features from the histology images without explicit mutation labels. The paper mentions using a specific self-supervised method called RetCCL.
  • Attention-based Multiple Instance Learning (attMIL): For the actual prediction task, the model employs an attention-based Multiple Instance Learning (MIL) approach. MIL is suitable for histology because whole slide images are large and can be broken down into smaller "patches" or "instances." The attention mechanism helps the model focus on the most relevant regions within these patches for predicting mutations.

The pipeline was trained on the TCGA dataset and then externally validated on the CPTAC dataset.

Datasets

The study utilized two large, multi-centric datasets:

  • The Cancer Genome Atlas (TCGA): Used for training the DL models.
  • Clinical Proteomic Tumor Analysis Consortium (CPTAC): Used for external validation of the trained models.

Seven tumor types were included across both datasets: breast (BRCA), colorectal (CRC), glioblastoma (GBM), lung adenocarcinoma (LUAD), lung squamous cell carcinoma (LUSC), pancreatic adenocarcinoma (PAAD), and uterine/endometrial cancer (UCEC). The study focused on predicting mutations in a curated list of clinically relevant genes, filtering for those with at least 25 mutants in the TCGA dataset.

Key Insights and Ideas

  • Generalizability is Key: The study strongly emphasizes the importance of external validation. Their self-supervised approach, when validated externally, shows robust performance, suggesting it's not just memorizing patterns specific to one dataset.
  • Histology as a Proxy for Genetics: The results reinforce the idea that subtle morphological changes in histology images, visible even in standard H&E stains, can be strong indicators of underlying genetic alterations.
  • Pan-Cancer Potential: The success across multiple tumor types suggests that a unified DL approach could be developed for broad cancer mutation prediction, rather than type-specific models.
  • Interpretable Predictions: The method provides interpretable spatial predictions (heatmaps), showing which areas of the tissue are most indicative of a particular mutation, which is crucial for clinical trust and understanding.

Key Results

  • The DL pipeline achieved robust predictability of genetic alterations across seven tumor types in an external validation cohort (CPTAC).
  • In endometrial cancer (UCEC), 145 out of 321 analyzable genes showed an AUROC (Area Under the Receiver Operating Characteristic curve) over 0.60, with 14 genes having an AUROC over 0.80.
  • Notable predictable mutations included NTRK1, MSH2, and PTEN in UCEC, and CREBBP in colorectal cancer.
  • The study found that tumor types with higher average tumor mutational burden (like UCEC, COAD, and LUAD) tended to have more predictable genes.
  • The method provided interpretable spatial predictions, including separate heatmaps for attention and classification.

Limitations and Future Work

  • Limited Gene Set: A significant limitation is that many clinically relevant genes could not be analyzed because they had fewer than 25 mutants in the TCGA dataset. This highlights the need for larger, more comprehensive datasets.
  • Federated/Swarm Learning: To overcome data limitations and enable broader analysis, the authors suggest that large-scale efforts using federated or swarm learning could be beneficial for creating datasets with sufficient size.
  • Clinical Routine: The study identifies clinically relevant candidate genes amenable to DL-based pre-screening, aiming to identify patients who could benefit from confirmatory genetic testing. This points towards future work in integrating such AI tools into clinical workflows.

Summary updated

Abstract

Abstract The histopathological phenotype of tumors reflects the underlying genetic makeup. Deep learning can predict genetic alterations from tissue morphology, but it is unclear how well these predictions generalize to external datasets. Here, we present a deep learning pipeline based on self-supervised feature extraction which achieves a robust predictability of genetic alterations in two large multicentric datasets of seven tumor types.
BibTeX
@misc{saldanha2022self,
  author = {Oliver Lester Saldanha and Chiara Maria Lavinia Loeffler and Jan Niehues and Marko van Treeck and Tobias Paul Seraphin and Katherine Hewitt and Didem Çifçi and Gregory Patrick Veldhuizen and Siddhi Ramesh and Alexander T. Pearson and Jakob Nikolas Kather},
  title = {{Self-supervised deep learning for pan-cancer mutation prediction from histopathology}},
  year = {2022},
  doi = {10.1101/2022.09.15.507455},
  howpublished = {bioRxiv},
}
Figure