Modeling Polypharmacy and Predicting Drug-Drug Interactions using Deep Generative Models on Multimodal Graphs

Nhat Khang Ngo, Truong Son-Hy, Risi KondorarXiv 2023 · DOI · OpenReview

Introduction

Polypharmacy—the concurrent use of multiple medications—is increasingly common in modern medicine, particularly for managing complex, chronic conditions. However, this practice significantly elevates the risk of adverse drug-drug interactions (DDIs). Given the astronomical number of possible drug combinations, clinical testing is unfeasible. While computational models offer a solution, many existing approaches rely on rigid latent representations that fail to capture the nuanced, continuous nature of biological interactions.

This work introduces a novel framework using Variational Graph Autoencoders (VGAE) to model drug interactions within multimodal biological networks. By treating latent representations as stochastic distributions rather than fixed points and augmenting them with molecular structural data, the proposed method achieves state-of-the-art performance in predicting polypharmacy side effects and drug sensitivities.

Methodology

Multimodal Graph Representation and Encoding

The foundation of the approach is a multimodal graph that integrates diverse biological entities, including drugs, proteins, and cancer cell lines. Nodes represent these entities, while edges denote specific interaction types, such as drug-target binding or a particular side effect (e.g., gastrointestinal distress).

Multimodal graph structure (a) and the relational message-passing scheme (b) used for initial node encoding.

To process this complex data, the authors employ a two-layer Graph Convolutional Network (GCN) with a relational message-passing scheme. As shown in Figure 1, each node aggregates information from its neighbors across different edge types, generating an initial embedding that captures the local network topology.

Variational Latent Space and Molecular Augmentation

The core innovation lies in the transition from a deterministic Graph Autoencoder to a Variational one. Instead of mapping a drug to a single vector, the encoder outputs the parameters (mean $\mu$ and variance $\sigma$) of a Gaussian distribution. This stochasticity ensures a continuous latent space, which is more robust for generalizing to unseen interactions.

The Variational Graph Autoencoder (VGAE) architecture, illustrating the generation of latent distributions and the integration of Morgan fingerprints.

Furthermore, the model incorporates "structural context" by concatenating the learned graph embeddings with Morgan fingerprints. These fingerprints provide a fixed-length bit-string representation of the drug's chemical structure. This hybrid approach allows the model to leverage both the drug's position in the biological network and its intrinsic molecular properties.

Experimental Evaluation

The model was rigorously tested across three major datasets:

  • Polypharmacy Dataset: 19,085 proteins and 645 drugs across 964 side-effect types.
  • DrugBank: 1,704 drugs categorized into 86 interaction types.
  • CCLE (Cancer Cell Line Encyclopedia): Used for predicting anticancer drug responses (IC50 scores).

Key Results

The VGAE model consistently outperformed established baselines:

  • Polypharmacy Side Effects: Achieved an AUROC of 0.944, a significant improvement over the Decagon model (0.872).
  • DrugBank Interactions: Reached 97.88% accuracy, surpassing SSI-DDI (94.47%).
  • Anticancer Response: Demonstrated a Pearson Correlation Coefficient (PCC) of 0.85 in predicting drug sensitivity.

Discussion and Future Work

A key insight from this research is that the latent space developed biological meaning; t-SNE visualizations showed that drug embeddings naturally clustered according to the Anatomical Therapeutic Chemical (ATC) classification system. This suggests the model captures fundamental pharmacological properties without explicit supervision.

While highly effective, the model's performance is tied to the quality of the input graph. Future research could explore the inclusion of "disease" nodes to facilitate drug repurposing or optimize the tensor factorization decoder to handle thousands of edge types more efficiently. By bridging the gap between molecular structure and systems biology, this generative approach provides a powerful tool for safer polypharmacy management.

Summary updated

Abstract

Latent representations of drugs and their targets produced by contemporary graph autoencoder models have proved useful in predicting many types of node-pair interactions on large networks, including drug-drug, drug-target, and target-target interactions. However, most existing approaches model either the node's latent spaces in which node distributions are rigid or do not effectively capture the interrelations between drugs; these limitations hinder the methods from accurately predicting drug-pair interactions. In this paper, we present the effectiveness of variational graph autoencoders (VGAE) in modeling latent node representations on multimodal networks. Our approach can produce flexible latent spaces for each node type of the multimodal graph; the embeddings are used later for predicting links among node pairs under different edge types. To further enhance the models' performance, we suggest a new method that concatenates Morgan fingerprints, which capture the molecular structures of each drug, with their latent embeddings before preceding them to the decoding stage for link prediction. Our proposed model shows competitive results on three multimodal networks: (1) a multimodal graph consisting of drug and protein nodes, (2) a multimodal graph constructed from a subset of the DrugBank database involving drug nodes under different interaction types, and (3) a multimodal graph consisting of drug and cell line nodes. Our source code is publicly available at https://github.com/HySonLab/drug-interactions.
BibTeX
@misc{ngo2023modeling,
  author = {Nhat Khang Ngo and Truong Son-Hy and Risi Kondor},
  title = {{Modeling Polypharmacy and Predicting Drug-Drug Interactions using Deep Generative Models on Multimodal Graphs}},
  year = {2023},
  eprint = {2302.08680},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2302.08680},
}
Figure