A multi-omics-based serial deep learning approach to predict clinical outcomes of single-agent anti-PD-1/PD-L1 immunotherapy in advanced stage non-small-cell lung cancer.

Yi Yang, Jiancheng Yang, Lan Shen, Jiajun Chen, Liliang Xia, Bingbing Ni, Liang Ge, Ying Wang, Shun LüPubMed 2021

TL;DR

This paper introduces a novel deep learning framework, SimTA, that integrates serial CT scans (radiomics), laboratory data, and clinical information to predict patient response to anti-PD-1/PD-L1 immunotherapy in advanced non-small-cell lung cancer (NSCLC). The model demonstrates superior performance in predicting response and stratifying patients for survival outcomes, particularly for those with stable disease, offering a more nuanced approach than traditional methods.

What Problem Does This Paper Address?

Immunotherapy has revolutionized NSCLC treatment, but only a fraction of patients (around 20%) experience durable responses. Current biomarkers are often limited by sample availability or lack predictive power across different immunotherapy agents. This leaves a significant unmet need for accurate, early prediction of who will benefit from these expensive and potentially toxic treatments. The authors aim to bridge this gap by developing a comprehensive predictive model that leverages multimodal, longitudinal data, moving beyond single time-point assessments and single data types.

Methods

The core innovation is the Simple Temporal Attention (SimTA) module. This module is designed to handle asynchronous time-series data, meaning data points collected at irregular intervals, which is common in clinical settings (e.g., CT scans and blood tests aren't always taken on the exact same schedule). SimTA processes these time series independently and then fuses their encoded representations with static clinical data.

The overall model pipeline involves:

  1. Radiomics Extraction: High-dimensional features are extracted from serial CT scans using PyRadiomics.
  2. Temporal Feature Encoding: Two SimTA modules are used, one for radiomics time series and another for blood test time series, to learn representations from these asynchronous data streams.
  3. Multimodal Fusion: The learned temporal features from SimTA, along with static clinical data (like age, sex, ECOG status), are combined.
  4. Prediction: A final Multi-Layer Perceptron (MLP) integrates these fused features to predict treatment response (responder vs. non-responder).

The model was trained and validated using 60-day and 90-day response prediction models.

Datasets

The study utilized a retrospective dataset of 200 advanced-stage NSCLC patients who received single-agent anti-PD-1/PD-L1 immunotherapy. This dataset comprised:

  • 1633 CT scans
  • 3414 blood samples

The data was collected from multiple clinical trials (CheckMate-870, CheckMate-078, OAK) and a real-world patient cohort. The inclusion criteria were specific, requiring patients to have ECOG scores of 0 or 1, measurable lesions, and complete baseline and follow-up data.

Key Insights and Ideas

  • Asynchronous Data is Key: The SimTA module's ability to handle irregularly timed data is crucial for real-world clinical prediction, as perfect synchronization is rarely achievable.
  • Multimodality Matters: Combining imaging (radiomics), laboratory, and clinical data provides a more holistic view of the patient's condition and response potential than any single modality alone.
  • Serial Data Enhances Prediction: Using longitudinal data (multiple CT scans and blood tests over time) significantly improves predictive accuracy compared to baseline data alone.
  • Beyond RECIST for Stable Disease: The model shows promise in identifying patients with stable disease (SD) who might still benefit from immunotherapy, a subgroup that is poorly differentiated by traditional RECIST criteria. This suggests that "stable" doesn't always mean "no benefit."

Key Results

  • The 90-day deep learning model achieved a good performance in distinguishing responders from non-responders, with an Area Under the Curve (AUC) of 0.80 (95% CI: 0.74-0.86).
  • The model successfully stratified patients into high- and low-risk groups for non-response. Low-risk patients had significantly longer Progression-Free Survival (PFS) (8.4 months vs. 1.5 months) and Overall Survival (OS) (26.7 months vs. 8.6 months) compared to high-risk patients.
  • In an exploratory analysis of 93 patients with stable disease (SD), the 90-day model also predicted survival outcomes, with low-risk SD patients showing significantly longer PFS (11.1 months vs. 3.3 months) and OS (31.7 months vs. 17.2 months).
  • The SimTA model outperformed baseline PD-L1 expression, baseline radiomics, and a standard RNN model in predicting response.

Limitations and Future Work

The authors acknowledge several limitations:

  • Limited Dataset Size: While the study included 200 patients, larger, more diverse datasets would strengthen the findings. They note that using serial data effectively "virtually increases" the training dataset.
  • Retrospective Nature: The study is retrospective, and inclusion criteria were relatively strict.
  • Data Modalities: The study focused on CT, laboratory, and clinical data. Future work could explore integrating other modalities like genomic or proteomic data.

Future directions suggested include:

  • Exploring Nonlinear Temporal Relations: While SimTA's linear temporal relation learning was effective, exploring nonlinear functions and self-attention could further refine the model.
  • Clinical Applications: Investigating the model's performance in more prospective, heterogeneous populations and across different clinical applications.
  • Broader Data Modalities: Expanding the multi-omics approach to include other data types.

Summary updated

Abstract

Only 20% NSCLC patients benefit from immunotherapy with a durable response. Current biomarkers are limited by the availability of samples and do not accurately predict who will benefit from immunotherapy. To develop a unified deep learning model to integrate multimodal serial information from CT with laboratory and baseline clinical information. We retrospectively analyzed 1633 CT scans and 3414 blood samples from 200 advanced stage NSCLC patients who received single anti-PD-1/PD-L1 agent between April 2016 and December 2019. Multidimensional information, including serial radiomics, laboratory data and baseline clinical data, was used to develop and validate deep learning models to identify immunotherapy responders and nonresponders. A Simple Temporal Attention (SimTA) module was developed to process asynchronous time-series imaging and laboratory data. Using cross-validation, the 90-day deep learning-based predicting model showed a good performance in distinguishing responders from nonresponders, with an area under the curve (AUC) of 0.80 (95% CI: 0.74-0.86). Before immunotherapy, we stratified the patients into high- and low-risk nonresponders using the model. The low-risk group had significantly longer progression-free survival (PFS) (8.4 months, 95% CI: 5.49-11.31 <i>vs</i>. 1.5 months, 95% CI: 1.29-1.71; HR 3.14, 95% CI: 2.27-4.33; log-rank test, <i>P</i><0.01) and overall survival (OS) (26.7 months, 95% CI: 18.76-34.64 <i>vs</i>. 8.6 months, 95% CI: 4.55-12.65; HR 2.46, 95% CI: 1.73-3.51; log-rank test, <i>P</i><0.01) than the high-risk group. An exploratory analysis of 93 patients with stable disease (SD) [after first efficacy assessment according to the Response Evaluation Criteria in Solid Tumors (RECIST) 1.1] also showed that the 90-day model had a good prediction of survival and low-risk patients had significantly longer PFS (11.1 months, 95% CI: 10.24-11.96 <i>vs</i>. 3.3 months, 95% CI: 0.34-6.26; HR 2.93, 95% CI: 1.69-5.10; log-rank test, P<0.01) and OS (31.7 months, 95% CI: 23.64-39.76 <i>vs</i>. 17.2 months, 95% CI: 7.22-27.18; HR 2.22, 95% CI: 1.17-4.20; log-rank test, <i>P</i>=0.01) than high-risk patients. In conclusion, the SimTA-based multi-omics serial deep learning provides a promising methodology for predicting response of advanced NSCLC patients to anti-PD-1/PD-L1 monotherapy. Moreover, our model could better differentiate survival benefit among SD patients than the traditional RECIST evaluation method.
BibTeX
@inproceedings{yang2021multi,
  author = {Yi Yang and Jiancheng Yang and Lan Shen and Jiajun Chen and Liliang Xia and Bingbing Ni and Liang Ge and Ying Wang and Shun Lü},
  title = {{A multi-omics-based serial deep learning approach to predict clinical outcomes of single-agent anti-PD-1/PD-L1 immunotherapy in advanced stage non-small-cell lung cancer.}},
  booktitle = {PubMed},
  year = {2021},
}
Figure