Deep Learning Predicts Survival Across Squamous Tumor Entities From H&E Stains: Insights from Head and Neck, Esophagus, Lung and Cervical Cancer

Verena Bitto, Xiaofeng Jiang, Michaël Baumann, Jakob Nikolas Kather, Ina KurthbioRxiv 2025 · DOI

TL;DR

This paper introduces a deep learning model that predicts patient survival using standard H&E stained tissue slides, demonstrating its effectiveness across multiple squamous cell carcinoma types beyond its initial training on head and neck cancers. This work highlights the potential of computational pathology to generalize and provide prognostic insights across different cancer entities, moving beyond single-cohort validation.

What Problem Does This Paper Address?

Extracting prognostic biomarkers from histopathology images using deep learning is a rapidly growing field. However, a major challenge is ensuring these models generalize well to unseen data and different patient populations or cancer types. Often, models are validated on a single, separate cohort, which limits our understanding of their broader applicability and explainability. This study aims to address this by developing a survival prediction model trained on head and neck squamous cell carcinoma (HNSCC) and then rigorously testing its performance and generalizability across other squamous tumor entities like esophageal, lung, and cervical cancers.

Methods

The core of this research involves using computational pathology (CP) and multiple instance learning (MIL).

  • Foundation Models for Feature Extraction: The study leverages pre-trained "foundation models" (specifically CTransPath, CONCH, and UNI) to extract meaningful histological features from patches of H&E stained whole-slide images (WSIs). These models are designed to capture complex patterns within the tissue.
  • Multiple Instance Learning (MIL): Since WSIs are large, MIL is employed. This approach treats the WSI as a "bag" of smaller image patches. The model learns to predict survival by aggregating information from these patches, rather than requiring a single label for the entire slide.
  • Survival Prediction Model: A MIL model was trained to optimize survival risk scores using a Cox partial likelihood loss. This is a standard method for analyzing time-to-event data, like patient survival. The model was trained specifically on the endpoint of overall survival (OS).
  • Validation and Generalization Testing: The trained model was validated on internal HNSCC cohorts and then tested on external cohorts of HNSCC, as well as other squamous cell carcinoma types (esophageal, lung, cervical). This multi-cohort evaluation is key to assessing generalizability.
  • Explainability: Attention heatmaps were generated to visualize which regions of the tissue were most influential in the model's survival predictions.

Datasets

The study utilized several publicly available datasets:

  • TCGA HNSC: Used for training the initial model.
  • TCGA ESCA (esophageal), TCGA LUSC (lung), TCGA CESC (cervical): Used for testing the model's generalizability to other squamous tumor entities.
  • BU HNSCC and DKTK HNSCC: Local cohorts used for validation and testing of the HNSCC model.

Key Insights and Ideas

  • Generalizability Beyond Training Cohort: The most significant insight is that a model trained on one squamous cell carcinoma type (HNSCC) can indeed predict survival in other, distinct squamous tumor entities. This suggests that the learned histological features capture fundamental prognostic information relevant across these related cancers.
  • Histology as a Rich Source of Prognostic Information: The study reinforces that standard H&E stained slides, when analyzed with advanced deep learning, contain rich prognostic signals that go beyond traditional clinical factors.
  • Foundation Models are Key Enablers: The use of pre-trained foundation models significantly simplifies the process of extracting relevant features, allowing the MIL model to focus on learning the survival prediction task.
  • Need for Comprehensive Validation: The authors strongly emphasize that validating models across diverse cohorts and tumor types is crucial for understanding their true utility and limitations, moving beyond single-cohort validation.

Key Results

  • The developed CP model demonstrated prognostic value in HNSCC cohorts, with significant p-values for survival prediction in TCGA HNSC (p < 0.0001), BU/DKTKmber HNSCC (p = 0.00088), and DKTKrem HNSCC (p = 0.003).
  • The model showed prognostic value in TCGA LUSC (p = 5e-04) and TCGA CESC (p = 0.0038), but not in TCGA ESCA (p = 0.73).
  • The predicted risk score was associated with clinical factors like HPV status, tumor volume, and smoking history, though these associations varied across cohorts.
  • Combining the predicted risk score with tumor volume (GTV) further improved survival stratification in the DKTKrem HNSCC cohort (p = 0.03).
  • Different foundation models (CTransPath, CONCH, UNI) showed varying degrees of success, with CTransPath and CONCH performing better than UNI.

Limitations and Future Work

  • Limited Prognostic Value in Esophageal Cancer: The model did not show prognostic value for esophageal carcinomas, suggesting that while generalizable across squamous types, there are still specificities that limit universal application.
  • Technical Variables: Factors like NPATCH (number of slide patches) showed some correlation with risk, potentially introducing bias or reflecting real biological differences. Further investigation into these technical variables is needed.
  • Sample Size: While the model generalized well, the authors acknowledge that training was performed on a relatively small sample size, and performance is expected to improve with more data.
  • Explainability of GTV Connection: Further exploration into the connection between the predicted risk score and tumor volume (GTV) could enhance model explainability, though GTV is often missing in clinical data.
  • Foundation Model Selection: The choice of foundation model can impact performance, and further research into optimal model selection for specific tasks and datasets is warranted. The authors suggest expanding explainability methods across tumor entities.

Summary updated

Abstract

Abstract Computational pathology-based models are becoming increasingly popular for extracting biomarkers from images of cancer tissue. However, their validity is often only demonstrated on a single unseen validation cohort, limiting insights into their generalizability and posing challenges for explainability. In this study, we developed models to predict overall survival using haematoxylin and eosin (H&amp;E) slides from FFPE samples in head and neck squamous cell carcinoma (HNSCC). By validating our models across diverse squamous tumor entities, including, head and neck (HR = 1.58, 95% CI = 1.17–2.12, p = 0.003), esophageal (non-significant), lung (HR = 1.31, 95% CI = 1.13–1.52, p &lt; 0.001) and cervical (HR = 1.39, 95% CI = 1.10–1.75, p = 0.005) squamous cell carcinomas, we showed that the predicted risk score captures relevant information for survival beyond HNSCC. Correlation analysis indicated that the predicted risk score is strongly associated with various clinical factors, including human papillomavirus status, tumor volume and smoking history, although the specific factors vary across cohorts. These results emphasize the necessity for comprehensive validation and in-depth assessment of computational pathology-based models to better characterize the underlying patterns they learn during training.
BibTeX
@misc{bitto2025deep,
  author = {Verena Bitto and Xiaofeng Jiang and Michaël Baumann and Jakob Nikolas Kather and Ina Kurth},
  title = {{Deep Learning Predicts Survival Across Squamous Tumor Entities From H\&amp;E Stains: Insights from Head and Neck, Esophagus, Lung and Cervical Cancer}},
  year = {2025},
  doi = {10.1101/2025.03.31.646351},
  howpublished = {bioRxiv},
}
Figure