Toward Explainable Anticancer Compound Sensitivity Prediction via Multimodal Attention-Based Convolutional Encoders

Matteo Manica, Ali Oskooei, Jannis Born, Vigneshwari Subramanian, Julio Sáez-Rodríguez, María Rodríguez Martínez

TL;DR

The authors introduce a Multiscale Convolutional Attentive (MCA) encoder to predict how specific cancer cell lines will respond to anticancer compounds. By integrating raw drug structures (SMILES), gene expression profiles, and protein interaction networks, the model not only achieves state-of-the-art predictive performance but also provides highly interpretable "attention maps" that highlight the exact biological and chemical features driving its predictions.

What Problem Does This Paper Address?

Precision oncology relies on matching a patient's unique tumor profile to the right drug. Machine learning models can predict this "drug sensitivity" (often measured as IC50, the concentration needed to inhibit 50% of cell growth), but they traditionally suffer from two major flaws. First, they rely on engineered chemical features (like Morgan fingerprints) that constrain the model's ability to learn novel structural patterns. Second, they act as black boxes; if a model predicts a drug will work, clinicians and chemists need to know why.

Furthermore, many existing models are evaluated using "lenient" data splits, meaning the model might just be memorizing drugs or cell lines it saw during training rather than learning generalizable rules for truly novel, unseen compounds. This paper tackles the need for a multimodal, highly interpretable model capable of generalizing to entirely new drug-cell pairs.

Methods

The team built a multimodal architecture based on three core pillars:

  1. Transcriptomics (The Cell): They used gene expression profiles of cancer cells. To avoid the curse of dimensionality, they used a network propagation technique over a Protein-Protein Interaction (PPI) network to filter ~17,000 genes down to a highly informative subset of 2,128 genes. A gene attention encoder then assigns weights to these genes.
  2. Drug Structure (The Drug): Instead of fingerprints, they used raw SMILES strings (text representations of molecules) and augmented them to make the model robust.
  3. Contextual Attention (The Bridge): They designed a novel Multiscale Convolutional Attentive (MCA) encoder. It uses parallel 1D CNNs with different kernel sizes to scan the SMILES string for various substructures (like specific chemical rings). Crucially, it uses a contextual attention mechanism where the cell line's gene expression acts as the context. This allows the model to focus on different parts of the molecule depending on the genetic makeup of the target cell.

To prove the model actually learns generalizable rules, they employed a "strict split" evaluation, ensuring no cell line or drug in the test set was ever seen during training.

Datasets

  • GDSC (Genomics of Drug Sensitivity in Cancer): Provided gene expression profiles for 985 pan-cancer cell lines and their IC50 drug sensitivity values.
  • PubChem & LINCS: Provided SMILES strings for 208 targeted anticancer drugs.
  • STRING: A comprehensive PPI network used to incorporate prior biological knowledge for the initial gene selection step.

Key Insights and Ideas

  • Raw sequences beat engineered features: Deep learning on raw SMILES strings significantly outperformed traditional 512-bit Morgan fingerprints, proving that the model can learn better chemical representations from scratch.
  • Context matters: The contextual attention mechanism successfully links the two modalities. The model literally learns to "look" at specific functional groups on a drug based on the specific genes expressed in the tumor.
  • Biological sanity checks: The model's attention weights align with known biology. The genes the model pays the most attention to are heavily involved in apoptosis (programmed cell death)—exactly what you'd expect for cancer drug efficacy.
  • Chemical sanity checks: The attention the model pays to different drugs correlates strongly with their actual structural similarity (Tanimoto coefficient), proving it is learning genuine chemistry.

Key Results

  • On the highly challenging strict split, the MCA model outperformed all baselines (including RNNs, standard CNNs, and fingerprint-based DNNs), achieving a standardized RMSE of 0.104.
  • On a standard lenient split (comparable to prior work), the model achieved an impressive $R^2$ of 0.86 (86.19% explained variance) and an RMSE of 0.887 on the log-IC50 scale.
  • Explainability Case Study: When comparing two very similar Tyrosine Kinase (TK) inhibitors (Imatinib and Masitinib) on a leukemia cell line, the model's attention map correctly highlighted the single functional group (a specific ring) that differs between the two drugs. Simultaneously, the gene attention heavily highlighted leukemia-relevant genes like DDR1 and BMP2K.

Limitations and Future Work

The authors note that the strict splitting strategy causes high variability across folds, highlighting just how difficult zero-shot prediction on entirely unseen drug-cell pairs is compared to lenient splitting.

For future work, they propose using this explainable predictor as an "oracle" in combination with generative AI (like autoencoders or reinforcement learning) to design de novo, patient-specific anticancer compounds. They also suggest its immediate utility for drug repositioning, as the model can predict sensitivity for any arbitrary drug-cell pair.

Summary updated

Abstract

In line with recent advances in neural drug design and sensitivity prediction, we propose a novel architecture for interpretable prediction of anticancer compound sensitivity using a multimodal attention-based convolutional encoder. Our model is based on the three key pillars of drug sensitivity: compounds' structure in the form of a SMILES sequence, gene expression profiles of tumors, and prior knowledge on intracellular interactions from protein-protein interaction networks. We demonstrate that our multiscale convolutional attention-based encoder significantly outperforms a baseline model trained on Morgan fingerprints and a selection of encoders based on SMILES, as well as the previously reported state-of-the-art for multimodal drug sensitivity prediction (<i>R</i><sup>2</sup> = 0.86 and RMSE = 0.89). Moreover, the explainability of our approach is demonstrated by a thorough analysis of the attention weights. We show that the attended genes significantly enrich apoptotic processes and that the drug attention is strongly correlated with a standard chemical structure similarity index. Finally, we report a case study of two receptor tyrosine kinase (RTK) inhibitors acting on a leukemia cell line, showcasing the ability of the model to focus on informative genes and submolecular regions of the two compounds. The demonstrated generalizability and the interpretability of our model testify to its potential for in silico prediction of anticancer compound efficacy on unseen cancer cells, positioning it as a valid solution for the development of personalized therapies as well as for the evaluation of candidate compounds in de novo drug design.
BibTeX
@inproceedings{manica2019toward,
  author = {Matteo Manica and Ali Oskooei and Jannis Born and Vigneshwari Subramanian and Julio Sáez-Rodríguez and María Rodríguez Martínez},
  title = {{Toward Explainable Anticancer Compound Sensitivity Prediction via Multimodal Attention-Based Convolutional Encoders}},
  booktitle = {Molecular},
  year = {2019},
  doi = {10.1021/acs.molpharmaceut.9b00520},
}

Loading related content...

Figure