Classifying Non-Small Cell Lung Cancer Histopathology Types and Transcriptomic Subtypes using Convolutional Neural Networks

Kun‐Hsing Yu, Feiran Wang, Gerald J. Berry, Christopher Ré, Russ B. Altman, M Snyder, Isaac S. KohanebioRxiv 2019 · DOI

TL;DR

This paper introduces a novel deep learning framework for classifying non-small cell lung cancer (NSCLC) subtypes directly from histopathology images. By leveraging convolutional neural networks (CNNs), the study demonstrates the ability to identify transcriptomic subtypes of NSCLC without prior pathology knowledge, paving the way for more objective and automated diagnostic tools.

What Problem Does This Paper Address?

Histopathological evaluation is the gold standard for diagnosing non-small cell lung cancer (NSCLC), but it can be subjective and prone to inter-observer variability. Furthermore, the link between the visual appearance of cancer cells (morphology) and their underlying molecular characteristics (transcriptomic subtypes) has not been systematically explored. This gap hinders a deeper understanding of how molecular alterations manifest visually and limits the development of objective, automated diagnostic tools. This paper aims to bridge this gap by developing a quantitative histopathology analytic framework to objectively identify gene expression subtypes of NSCLC using CNNs.

Methods

The core of this research lies in the application of Convolutional Neural Networks (CNNs) for image analysis. The authors employed several established CNN architectures, including AlexNet, GoogLeNet, VGGNet-16, and ResNet-50, all fine-tuned from models pre-trained on ImageNet. These networks were trained to perform three key classification tasks:

  1. Distinguishing lung adenocarcinoma from adjacent benign tissue.
  2. Distinguishing lung squamous cell carcinoma from adjacent benign tissue.
  3. Differentiating between lung adenocarcinoma and lung squamous cell carcinoma.

To interpret the CNNs' decisions, they utilized Gradient-weighted Class Activation Maps (Grad-CAM), which highlight the regions in the histopathology images that the network found most important for its classification. For correlating morphology with molecular subtypes, they employed principal component analysis (PCA) on the CNN's output and Spearman's correlation coefficients to assess the relationships.

Datasets

The study utilized two primary datasets:

  • The Cancer Genome Atlas (TCGA): This dataset provided whole-slide histopathology images from 427 lung adenocarcinoma patients and 457 lung squamous cell carcinoma patients.
  • International Cancer Genome Consortium (ICGC): This served as an independent validation dataset, comprising images from 87 lung adenocarcinoma and 38 lung squamous cell carcinoma patients.

Key Insights and Ideas

  • Bridging the Morphology-Genetics Divide: The most significant insight is the successful demonstration that visual features in histopathology images can directly correlate with and predict molecular (transcriptomic) subtypes of NSCLC. This suggests that the visual appearance of cancer cells is not arbitrary but carries information about their underlying genetic drivers.
  • Objective Classification: The use of CNNs allows for a highly objective and reproducible classification of cancer subtypes, overcoming the limitations of human interpretation.
  • Discovery of Novel Patterns: The framework's ability to identify patterns without prior pathology knowledge opens the door to discovering previously unrecognized histopathological features that are clinically relevant.
  • Generalizability: The success across different NSCLC subtypes and validation on an independent cohort suggests the developed approach is robust and potentially generalizable to other cancer types or diseases.

Key Results

  • High Classification Accuracy: The CNN models achieved high accuracy in distinguishing tumor types from benign tissue, with Area Under the Receiver Operating Characteristic Curve (AUC) values generally above 0.935 for tumor vs. benign classification in the TCGA test set.
  • Recapitulating Expert Diagnosis: The models were able to recapitulate expert pathologists' diagnoses with AUCs greater than 0.88.
  • Validating in Independent Cohort: Performance was maintained in an independent validation cohort, with AUCs above 0.85.
  • Identifying Transcriptomic Subtypes: Quantitative histopathology features were shown to significantly identify major transcriptomic subtypes of both adenocarcinoma (P < 0.01) and squamous cell carcinoma (P < 0.01).
  • Performance Improvement: The developed neural networks achieved a 9-12% performance improvement compared to previously reported quantitative methods for pathology analysis on the TCGA datasets.

Limitations and Future Work

  • Limited Histology Types: The study primarily focused on the two most common NSCLC types: adenocarcinoma and squamous cell carcinoma. The diagnostic performance for rarer tumor types (e.g., giant-cell carcinoma, small cell lung carcinoma) could not be evaluated due to data limitations.
  • Retrospective Data: All histopathology images were gathered retrospectively, and updated classification standards were not available for the study cohorts.
  • Future Directions: The authors suggest further studies to establish cell-level image-transcriptomics associations using single-cell sequencing and to validate the utility of computer vision methods for diagnosing other prevalent tumor types. They also emphasize the need for prospective studies and large-scale data collection for rarer cancer types to develop comprehensive diagnostic systems. The potential for augmenting pathology workflows and reducing misdiagnosis-related costs and loss of life is highlighted.

Summary updated

Abstract

Abstract Non-small cell lung cancer is a leading cause of cancer death worldwide, and histopathological evaluation plays the primary role in its diagnosis. However, the morphological patterns associated with the molecular subtypes have not been systematically studied. To bridge this gap, we developed a quantitative histopathology analytic framework to identify the gene expression subtypes of non-small cell lung cancer objectively. We processed whole-slide histopathology images of lung adenocarcinoma (n=427) and lung squamous cell carcinoma patients (n=457) in The Cancer Genome Atlas. To establish neural networks for quantitative image analyses, we first build convolutional neural network models to identify tumor regions from adjacent dense benign tissues (areas under the receiver operating characteristic curves (AUC) &gt; 0.935) and recapitulated expert pathologists’ diagnosis (AUC &gt; 0.88), with the results validated in an independent cohort (n=125; AUC &gt; 0.85). We further demonstrated that quantitative histopathology morphology features identified the major transcriptomic subtypes of both adenocarcinoma and squamous cell carcinoma (P &lt; 0.01). Our study is the first to classify the transcriptomic subtypes of non-small cell lung cancer using fully-automated machine learning methods. Our approach does not rely on prior pathology knowledge and can discover novel clinically-relevant histopathology patterns objectively. The developed procedure is generalizable to other tumor types or diseases.
BibTeX
@misc{yu2019classifying,
  author = {Kun‐Hsing Yu and Feiran Wang and Gerald J. Berry and Christopher Ré and Russ B. Altman and M Snyder and Isaac S. Kohane},
  title = {{Classifying Non-Small Cell Lung Cancer Histopathology Types and Transcriptomic Subtypes using Convolutional Neural Networks}},
  year = {2019},
  doi = {10.1101/530360},
  howpublished = {bioRxiv},
}
Figure