Predicting clinical drug response from model systems by non-linear subspace-based transfer learning

Soufiane Mourragui, Marco Loog, Daniël J. Vis, Kat Moore, Anna G. Manjón, Mark A. van de Wiel, Marcel Reinders, Lodewyk F.a. WesselsbioRxiv 2020 · DOI

TL;DR

This paper introduces TRANSACT, a novel computational framework that uses non-linear transfer learning to predict clinical drug response by bridging the gap between pre-clinical models and human tumors. TRANSACT significantly outperforms existing methods, offering a more robust way to leverage vast pre-clinical data for personalized cancer treatment.

What Problem Does This Paper Address?

Cancer research heavily relies on pre-clinical models like cell lines and patient-derived xenografts (PDXs) to understand drug responses. However, these models often fail to fully capture the complexity of human tumors, leading to a significant challenge in translating findings from the lab to the clinic. This "domain shift" means that models trained on pre-clinical data don't always perform well when applied to human patient data, hindering the development of effective biomarkers and personalized medicine. The authors aim to overcome this by developing a method that explicitly accounts for and bridges these differences.

Methods

The core of TRANSACT is its non-linear subspace-based transfer learning approach. Here's a breakdown:

  1. Non-linear Manifold Learning: TRANSACT uses kernel methods (specifically Kernel PCA) to learn non-linear relationships within both pre-clinical (source) and human tumor (target) datasets independently. This captures complex biological processes that linear methods might miss.
  2. Geometric Alignment: Instead of directly comparing data distributions, TRANSACT aligns the learned non-linear principal components (NLPCs) from the source and target domains using principal vectors. This geometric alignment helps to find shared underlying structures.
  3. Consensus Features: Through an interpolation process, TRANSACT creates "consensus features" that balance the information from both pre-clinical and tumor data. These features represent a shared subspace.
  4. Predictor Transfer: Drug response predictors are trained on the pre-clinical data projected onto these consensus features and then transferred to predict responses in human tumors.

A key innovation is the explicit modeling of non-linearities in the transfer process, moving beyond simpler linear domain adaptation methods.

Datasets

The study utilizes several publicly available and proprietary datasets:

  • GDSC (Genomics of Drug Sensitivity in Cancer): A large panel of cancer cell lines used as the primary source domain for training predictors.
  • NIBR PDXE (Novartis Patient-Derived Xenografts): Used for evaluating the transfer of predictors from cell lines to PDXs.
  • TCGA (The Cancer Genome Atlas): A dataset of human primary tumors used as a target domain for evaluating drug response prediction.
  • Hartwig Medical Foundation (HMF): A dataset of human metastatic lesions, also used as a target domain.

Key Insights and Ideas

  • Non-linearity is Crucial: The paper strongly suggests that simply applying linear methods or treating pre-clinical/clinical differences as batch effects is insufficient. Capturing non-linear relationships is key to successful transfer learning in this domain.
  • Geometric Alignment Outperforms Distributional Comparison: By focusing on aligning the geometric structure of the learned representations (NLPCs) rather than directly comparing data distributions, TRANSACT is less susceptible to sample-level biases.
  • Interpretability Matters: TRANSACT's framework allows for the interpretation of the learned consensus features, enabling the identification of known and novel biomarkers for drug sensitivity and resistance. This is crucial for building trust and understanding the biological basis of predictions.
  • Pre-clinical Data is Highly Valuable: Despite their limitations, pre-clinical models contain a wealth of information that, when properly leveraged through methods like TRANSACT, can significantly improve our ability to predict clinical drug response.

Key Results

  • Improved Prediction Accuracy: TRANSACT consistently outperformed four competing approaches (Elastic Net, Deep Learning, ComBat+DL, and PRECISE) across multiple drugs and datasets.
  • Significant Gains in Human Tumors: The framework showed significant improvements in predicting drug response for drugs in TCGA (5 drugs) and HMF (3 drugs) cohorts, often outperforming state-of-the-art methods.
  • Robustness to Initialization: Unlike deep learning approaches, TRANSACT's performance was not dependent on random network initialization, making it more reliable.
  • Biomarker Discovery: The interpretability of TRANSACT led to the identification of potential biomarkers for resistance to Paclitaxel and Gemcitabine, as well as validation of known mechanisms for targeted therapies like Afatinib and Gefitinib.

Limitations and Future Work

  • Assumption of Monotonicity: The authors acknowledge that their approach assumes that the functions modeling response from consensus features follow the same monotonicity in pre-clinical models and human tumors. While reasonable, this assumption may be questioned in some cases.
  • Gene Expression Focus: The study primarily focused on gene expression data. The authors suggest that integrating other genomic levels (mutations, methylation, etc.) could further refine predictions.
  • Model System Limitations: While TRANSACT bridges the gap, it doesn't fully replicate the complexity of the tumor microenvironment or immune system.
  • Future Directions: The authors envision extending TRANSACT to integrate multi-omics data, leverage large-scale cell line combination screens for training, and adapt it for predicting responses to immunotherapies by incorporating model systems that better mimic the immune system.

Summary updated

Abstract

Abstract Pre-clinical models have been the workhorse of cancer research for decades. While powerful, these models do not fully recapitulate the complexity of human tumors. Consequently, translating biomarkers of drug response from pre-clinical models to human tumors has been particularly challenging. To explicitly take these differences into account and enable an efficient exploitation of the vast pre-clinical drug response resources, we developed TRANSACT, a novel computational framework for clinical drug response prediction. First, TRANSACT employs non-linear manifold learning to capture biological processes active in pre-clinical models and human tumors. Then, TRANSACT builds predictors on cell line response only and transfers these to Patient-Derived Xenografts (PDXs) and human tumors. TRANSACT outperforms four competing approaches, including Deep Learning approaches, for a set of 15 drugs on PDXs, TCGA cohorts and 226 metastatic tumors from the Hartwig Medical Foundation data. For only four drugs Deep Learning outperforms TRANSACT. We further derived an algorithmic approach to interpret TRANSACT and used it to validate the approach by identifying known biomarkers to targeted therapies and we propose novel putative biomarkers of resistance to Paclitaxel and Gemcitabine.
BibTeX
@misc{mourragui2020predicting,
  author = {Soufiane Mourragui and Marco Loog and Daniël J. Vis and Kat Moore and Anna G. Manjón and Mark A. van de Wiel and Marcel Reinders and Lodewyk F.A. Wessels},
  title = {{Predicting clinical drug response from model systems by non-linear subspace-based transfer learning}},
  year = {2020},
  doi = {10.1101/2020.06.29.177139},
  howpublished = {bioRxiv},
}
Figure