An uncertainty-based interpretable deep learning framework for breast cancer outcomes prediction

Hua Chai, Siyin Lin, Minfan He, Yuedong Yang, Ouyang Yongzhong, Huiying ZhaobioRxiv 2022 · DOI

TL;DR

This paper introduces UISNet, a novel deep learning framework for predicting breast cancer outcomes. It tackles the critical challenge of interpretability in deep learning models by integrating an uncertainty-based approach with integrated gradients, allowing for the identification of important prognostic genes. UISNet demonstrates superior accuracy compared to existing methods, offering a more reliable tool for clinical decision-making and biomarker discovery.

What Problem Does This Paper Address?

Accurate prediction of breast cancer outcomes is crucial for tailoring treatment, improving patient survival, and enhancing quality of life. While deep learning (DL) models have shown promise in this area, their "black box" nature poses a significant hurdle. Understanding why a model makes a certain prediction is vital for clinical adoption, enabling the identification of key prognostic factors and potential therapeutic targets. Existing interpretability methods for DL models often struggle with issues like gradient saturation or selecting features that aren't truly driving the prediction. This paper aims to bridge this gap by developing an interpretable DL framework that not only predicts outcomes accurately but also provides reliable insights into feature importance.

Methods

The core of this work is the UISNet (Uncertainty-based Interpretable Semi-supervised Network) framework. UISNet is a multi-task deep neural network designed to simultaneously handle several key aspects of cancer outcome prediction:

  • Dimension Reduction: It uses an encoder-decoder structure to learn compressed, high-quality features from high-dimensional gene expression data.
  • Patient Heterogeneity Clustering: It incorporates a subtype clustering task to capture the diverse biological characteristics of breast cancer patients.
  • Prognosis Prediction: It employs a deep neural network with a proportional hazard loss function to predict patient survival.

What makes UISNet novel is its approach to interpretability:

  • Uncertainty-Based Integrated Gradients: Instead of relying solely on standard integrated gradients (which can suffer from issues like gradient saturation), UISNet combines this with Monte Carlo dropout. This allows for the quantification of prediction uncertainty, leading to more reliable feature importance scores. The importance weight of a gene is calculated by considering both its integrated gradient score and its uncertainty.
  • Prior Biological Pathway Knowledge: UISNet integrates prior biological pathway information (from KEGG and Reactome databases) into a sparse layer. This helps guide the network and ensures that learned relationships between genes and pathways are biologically relevant.

Datasets

The study utilized seven publicly available breast cancer datasets from the Gene Expression Omnibus (GEO) and The Cancer Genome Atlas (TCGA) databases. These datasets were preprocessed by log transformation and batch effect removal. The paper provides a table detailing the number of uncensored samples, total samples, and censoring rates for each dataset. No new benchmark datasets were introduced.

Key Insights and Ideas

  • Interpretability is Key for Clinical Trust: The paper strongly emphasizes that for DL models to be adopted in clinical settings, they must be interpretable. Simply achieving high accuracy is not enough; understanding the underlying reasons for a prediction is paramount.
  • Uncertainty Matters for Feature Importance: The integration of uncertainty quantification with integrated gradients is a significant contribution. It suggests that a feature's importance is not just about its direct influence (gradient) but also about how reliably that influence can be measured. High uncertainty might indicate a less dependable feature.
  • Biological Priors Enhance Model Performance and Interpretability: Incorporating biological pathway knowledge into the network architecture not only improves prediction accuracy but also grounds the learned features in biological reality, making the interpretations more meaningful.
  • Multi-Task Learning for Holistic Prediction: By unifying dimension reduction, patient clustering, and outcome prediction into a single framework, UISNet can learn shared representations that benefit all tasks, leading to a more robust and comprehensive model.

Key Results

  • Superior Prediction Accuracy: UISNet outperformed state-of-the-art methods on average, achieving a 5.79% higher C-index value.
  • Identification of Prognostic Genes: The interpretable model successfully identified genes associated with breast cancer prognosis. Notably, 11 out of the top 20 identified genes were validated through literature review, underscoring the biological relevance of the findings.
  • Robustness: The comprehensive tests indicated that UISNet is accurate and robust in predicting breast cancer outcomes.

Limitations and Future Work

  • Computational Cost: While not explicitly detailed as a limitation, the use of Monte Carlo dropout for uncertainty estimation implies a higher computational cost compared to models without this feature.
  • Hyperparameter Tuning: The paper mentions that hyperparameters like the weights for different tasks ($\gamma$ and $\beta$) and learning rates were selected via cross-validation, suggesting that careful tuning is required for optimal performance.
  • Future Work: The authors suggest that their framework is an effective way to identify prognosis-related genes, implying that further research could focus on exploring these identified genes for therapeutic targets or developing more refined gene selection strategies. The availability of the code on GitHub suggests potential for further development and application by the research community.

Summary updated

Abstract

Abstract Accurate prediction of breast cancer outcomes is important for selecting appropriate treatment, which can prolong the survival period of the patients and improve the life quality. Recently, different deep learning-based methods are carefully designed for cancer outcomes prediction. However, the applications of these methods are still challenging due to the model interpretability. In this study, we proposed a novel multi-task deep neural network UISNet to interpret the feature importance of the prediction model by an uncertainty-based integrated gradients algorithm. Additionally, UISNet improves the prediction accuracy by introducing the prior biological pathway knowledge and utilizing the patients’ heterogeneity information. By applications to seven breast cancer public datasets, the method was shown to outperform state-of-the-art methods by achieving a 5.79% higher C-index value on average. For the identified genes based on the interpretable model, 11 out of the top 20 genes have been proved to be associated with breast cancer by literature review. The comprehensive tests indicated that our proposed method is accurate and robust to predict breast cancer outcomes, and is an effective way to identify the prognosis-related genes. The method codes are available at: https://github.com/chh171/UISNet .
BibTeX
@misc{chai2022uncertainty,
  author = {Hua Chai and Siyin Lin and Minfan He and Yuedong Yang and Ouyang Yongzhong and Huiying Zhao},
  title = {{An uncertainty-based interpretable deep learning framework for breast cancer outcomes prediction}},
  year = {2022},
  doi = {10.1101/2022.08.25.505346},
  howpublished = {bioRxiv},
}
Figure