Machine learning models based on immunological genes to predict the response to neoadjuvant therapy in breast cancer patients

Jian Chen, Hao Li, Xiaojun Qian, Lin Lin, Yueyin Pan, Xinghua HanFrontiers in Immunology 2022 · DOI

TL;DR

This paper introduces two machine learning models, "Ipredictor" and "ICpredictor," that leverage immunological gene expression to predict pathological complete response (pCR) to neoadjuvant therapy (NAT) in breast cancer patients. These models demonstrate robust performance across both RNA-seq and microarray platforms, offering a promising avenue for personalized treatment strategies.

What Problem Does This Paper Address?

Neoadjuvant therapy (NAT) is a crucial treatment for early-stage breast cancer (BC), aiming to shrink tumors before surgery and assess treatment efficacy. However, only a fraction of patients achieve a pathological complete response (pCR), indicating successful treatment. Predicting which patients will benefit from NAT is essential to avoid unnecessary toxicity and optimize treatment plans. While previous models have used gene expression, they often rely on microarray data, which has limitations compared to the more accurate RNA-sequencing (RNA-seq) platform. Furthermore, existing models can be hindered by data normalization methods that lead to data leakage and limited clinical applicability. This paper addresses the need for more robust and clinically relevant predictive models for NAT response in BC, specifically utilizing the advantages of RNA-seq data.

Methods

The researchers employed a multi-stage machine learning approach. First, they identified 62 immunological genes significantly associated with pCR using Spearman rank correlation on an RNA-seq training dataset. They then developed two primary models:

  • Ipredictor Model: This model is based solely on the expression of these 62 immunological genes.
  • ICpredictor Model: This model combines the immunological gene expression with key clinicopathological features (estrogen receptor (ER), progesterone receptor (PR), and human epidermal growth factor receptor 2 (HER2) status).

A model stacking strategy was utilized, involving multiple "base" machine learning algorithms (Lasso, Ridge Regression, Elastic Net, SVM, Random Forest, LightGBM, and various neural networks) trained on the initial data. The outputs of these base models were then fed into "meta" models to generate the final prediction scores. Hyperparameters for all models were optimized using Bayesian optimization with stratified 5-fold cross-validation. For comparison, a model based solely on clinicopathological characteristics (CPpredictor) was also developed.

Datasets

The study utilized several publicly available datasets:

  • Training Set: GSE163882 (RNA-seq)
  • Independent External Test Set 1: GSE123845 (RNA-seq)
  • Independent External Test Set 2: GSE20271 (Microarray)
  • Additional Data: The Cancer Genome Atlas (TCGA-BRCA) for mutation and immune microenvironment data.

The researchers specifically highlight the advantage of using RNA-seq data over microarray data due to its higher accuracy, reproducibility, and wider dynamic range. They also note that their approach avoids data leakage issues common in previous microarray-based models.

Key Insights and Ideas

  • Immune Microenvironment is Key: The study strongly reaffirms the critical role of the tumor immune microenvironment in predicting NAT response. Patients achieving pCR showed increased infiltration of various immune cells, particularly lymphocytes.
  • RNA-seq Advantage: The paper champions RNA-seq over microarray for building predictive models, citing its superior accuracy and robustness, and demonstrating that models trained on RNA-seq can generalize well to microarray data.
  • Model Stacking for Robustness: The use of a model stacking strategy, combining diverse base learners, likely contributed to the models' strong performance and ability to capture complex relationships.
  • Beyond Clinicopathological Features: While clinicopathological features are important, the immunological gene-based models significantly outperformed them in predictive accuracy, suggesting that molecular signatures offer a deeper insight into treatment response.
  • Predictive Score as a Biomarker: The predictive score generated by the Ipredictor model was found to correlate with immune microenvironment characteristics and genomic aberrations, suggesting it acts as a comprehensive indicator of tumor biology and potential treatment response.

Key Results

  • Predictive Performance:
    • RNA-seq Test Set: The Ipredictor model achieved an Area Under the Receiver Operator Characteristic Curve (AUROC) of 0.745, and the ICpredictor model achieved 0.769.
  • Microarray Test Set: The Ipredictor model achieved an AUROC of 0.716, and the ICpredictor model achieved 0.752.
  • Superiority over Existing Models: Both Ipredictor and ICpredictor models outperformed previously proposed models and markers (e.g., DLDA30 scores, GGI, Oncotype DX, MammaPrint) on the microarray dataset.
  • Correlation with Biological Features: The predictive score from the Ipredictor model showed significant correlations with immune cell infiltration, tumor purity, and various genomic aberration markers.
  • Subgroup Performance: The models demonstrated good predictive ability across different patient subgroups, including those with ER+/HER2- status, who are often considered less responsive to NAT.

Limitations and Future Work

The authors acknowledge several limitations:

  • Sensitivity vs. Specificity Trade-off: The models exhibit high specificity (correctly identifying non-responders) but lower sensitivity (missing some responders) in the test sets. This means that while predicted responders are likely to respond, predicted non-responders might still achieve pCR.
  • Dataset Shift: Differences in genetic background, treatment, and clinicopathological characteristics between datasets may have contributed to performance variations between training and test sets, suggesting the need for optimal threshold calibration.
  • Subgroup Performance Variation: While generally good, model performance varied across different breast cancer subtypes, indicating that future work could involve training specialized submodels for each subtype.
  • Clinical Application: The models are not yet ready for direct clinical application and require further validation in large prospective studies.

Future work should focus on addressing these limitations, including refining threshold selection, developing subtype-specific models, and conducting extensive prospective validation to translate these findings into clinical practice for personalized breast cancer treatment.

Summary updated

Abstract

Breast cancer (BC) is the most common malignancy worldwide and neoadjuvant therapy (NAT) plays an important role in the treatment of patients with early BC. However, only a subset of BC patients can achieve pathological complete response (pCR) and benefit from NAT. It is therefore necessary to predict the responses to NAT. Although many models to predict the response to NAT based on gene expression determined by the microarray platform have been proposed, their applications in clinical practice are limited due to the data normalization methods during model building and the disadvantages of the microarray platform compared with the RNA-seq platform. In this study, we first reconfirmed the correlation between immune profiles and pCR in an RNA-seq dataset. Then, we employed multiple machine learning algorithms and a model stacking strategy to build an immunological gene based model (Ipredictor model) and an immunological gene and receptor status based model ICpredictor model) in the RNA-seq dataset. The areas under the receiver operator characteristic curves for the Ipredictor model and ICpredictor models were 0.745 and 0.769 in an independent external test set based on the RNA-seq platform, and were 0.716 and 0.752 in another independent external test set based on the microarray platform. Furthermore, we found that the predictive score of the Ipredictor model was correlated with immune microenvironment and genomic aberration markers. These results demonstrated that the models can accurately predict the response to NAT for BC patients and will contribute to individualized therapy.
BibTeX
@inproceedings{chen2022machine,
  author = {Jian Chen and Hao Li and Xiaojun Qian and Lin Lin and Yueyin Pan and Xinghua Han},
  title = {{Machine learning models based on immunological genes to predict the response to neoadjuvant therapy in breast cancer patients}},
  booktitle = {Frontiers in Immunology},
  year = {2022},
  doi = {10.3389/fimmu.2022.948601},
}
Figure