GANDALF: Generative AttentioN based Data Augmentation and predictive modeLing Framework for personalized cancer treatment

Aishwarya Jayagopal, Yanrong Zhang, Robert John Walsh, Tuan Zea Tan, Anand D Jeyasekharan, Vaibhav RajanICLR 2025 · OpenReview

GANDALF: Generative AttentioN based Data Augmentation and predictive modeLing Framework

Overview

GANDALF is a novel generative framework designed to predict how individual cancer patients will respond to specific drugs. By utilizing diffusion models and attention mechanisms to "translate" abundant laboratory cell-line data into realistic synthetic patient data, it overcomes the chronic shortage of labeled clinical datasets. This approach allows GANDALF to significantly outperform current state-of-the-art models in precision oncology.

The Challenge: Predicting Drug Response

The "holy grail" of precision oncology is predicting which drug will work for a specific patient based on their unique genetic mutations. However, training machine learning models for this task is incredibly difficult because labeled patient data—records showing both a patient’s genomic profile and their actual clinical response to a drug—is extremely scarce.

To solve this data shortage, researchers often turn to "cell lines" (cancer cells grown in a lab). While cell line data is abundant, it has a major biological flaw: a dish in a lab is not a human body. Lab-grown cells lack a "tumor microenvironment" (blood vessels, immune systems, etc.), meaning they acquire mutations and respond to drugs differently than real patients. Previous computational methods tried to find a "shared space" between the two domains, but in doing so, they often discarded the patient-specific characteristics that are vital for accurate clinical prediction.

Overview of the drug response prediction challenge

The GANDALF Framework

The authors introduce GANDALF (Generative AttentioN based Data Augmentation and predictive modeLing), which tackles this domain gap using a multi-step generative pipeline:

  1. Representation Learning: The framework uses Variational Autoencoders (VAEs) and Denoising Diffusion Probabilistic Models (DDPMs) to decompose genomic data into domain-invariant features (shared by both cell lines and patients) and domain-specific features (unique to either patients or cell lines).
  2. Cross-Attention Augmentation: Instead of just finding a shared space, GANDALF generates new "patient-like" samples by transforming cell line data. It uses a cross-attention mechanism to ensure the synthetic data retains the core biological signal of the mutations while adopting the "style" or distribution of real patient data.
  3. Multi-Task Pseudo-Labeling: Because cell lines are evaluated with continuous scores (AUDRC) and patients with binary outcomes (RECIST), GANDALF uses a multi-task learning (MTL) network to bridge this gap and assign high-confidence "pseudo-labels" to the synthetic data.
  4. Downstream Prediction: Finally, a drug response prediction (DRP) classifier is trained on a combination of real patient data and the most confident synthetic samples.

Datasets and Scope

The study utilizes several high-profile public datasets to train and validate the model:

  • Cell Lines: CCLE (Cancer Cell Line Encyclopedia) and DepMap for mutation profiles, alongside GDSCv2 for drug response metrics.
  • Patient Data: TCGA (The Cancer Genome Atlas), CbioPortal (CBIO), and the UC San Diego Moores Cancer Center.
  • Pretraining: The GENIE registry was used to pretrain the transformer-based mutation encoder.

The analysis focused on 324 genes (based on the FoundationOne CDx clinical panel) and 5 primary anti-cancer drugs: Cisplatin, Paclitaxel, 5-Fluorouracil, Gemcitabine, and Temozolomide.

Key Insights and Results

  • Treating "Patient-ness" as a Signal: Most transfer learning models treat the difference between lab cells and patients as "noise" to be removed. GANDALF treats this difference as a specific signal that needs to be modeled and generated.
  • Quality over Quantity: The framework includes a "confidence" filter. It only keeps synthetic samples where the pseudo-labeling is highly certain, preventing the model from being "poisoned" by noisy examples.
  • Superior Performance: GANDALF achieved the best AUROC (Area Under the Receiver Operating Characteristic) for four out of the five drugs tested, outperforming recent state-of-the-art models like DruID and PANCDR by up to 10.96%.
  • Distribution Fidelity: t-SNE and PCA visualizations confirmed that GANDALF’s generated samples were statistically much closer to real patient distributions than the original cell line data.
  • Ablation Success: Removing the Transformer encoder or the Multi-Task Learning head led to significant performance drops, proving that both the sophisticated mutation encoding and the cross-domain labeling are essential.

Limitations and Future Work

While highly effective, GANDALF is a computationally "heavy" framework with multiple sub-modules (VAEs, DDPMs, Transformers) that require separate pretraining stages. Furthermore, while it successfully augments data, the model's ability to learn the underlying distribution is still ultimately limited by the quality and diversity of the initial small patient datasets.

Future directions suggested by the authors include incorporating more biological priors—like known pathways or co-occurring mutations—into the generative process. They also aim to explore how different tumor types (solid vs. non-solid) affect the model's accuracy, potentially paving the way for tumor-specific versions of the GANDALF framework.

Summary updated

Abstract

Effective treatment of cancer is a major challenge faced by healthcare providers, due to the highly individualized nature of patient responses to treatment. This is caused by the heterogeneity seen in cancer-causing alterations (mutations) across patient genomes. Limited availability of response data in patients makes it difficult to train personalized treatment recommendation models on mutations from clinical genomic sequencing reports. Prior methods tackle this by utilising larger, labelled pre-clinical laboratory datasets (‘cell lines’), via transfer learning. These methods augment patient data by learning a shared, domain-invariant representation, between the cell line and patient domains, which is then used to train a downstream drug response prediction (DRP) model. This approach augments data in the shared space but fails to model patient-specific characteristics, which have a strong influence on their drug response. We propose a novel generative attention-based data augmentation and predictive modeling framework, GANDALF, to tackle this crucial shortcoming of prior methods. GANDALF not only augments patient genomic data directly, but also accounts for its domain-specific characteristics. GANDALF outperforms state-of-the-art DRP models on publicly available patient datasets and emerges as the front-runner amongst SOTA cancer DRP models.
BibTeX
@inproceedings{jayagopal2025gandalf,
  author = {Aishwarya Jayagopal and Yanrong Zhang and Robert John Walsh and Tuan Zea Tan and Anand D Jeyasekharan and Vaibhav Rajan},
  title = {{GANDALF: Generative AttentioN based Data Augmentation and predictive modeLing Framework for personalized cancer treatment}},
  booktitle = {International Conference on Learning Representations},
  year = {2025},
  url = {https://openreview.net/forum?id=WwmtcGr4lP},
}
Figure