π’ͺ-GNN: incorporating ring priors into molecular modeling

Jinhua Zhu, Kehan Wu, Bohan Wang, Yingce Xia, Shufang Xie, Qi Meng, Lijun Wu, Tao Qin, Wengang Zhou, Houqiang Li, Tie-Yan Liu

TL;DR

This paper introduces π’ͺ-GNN, a novel graph neural network architecture that explicitly models ring structures in molecules. By incorporating ring information, π’ͺ-GNN demonstrates enhanced expressiveness and achieves state-of-the-art results on molecular property prediction, drug-drug interaction prediction, and retrosynthesis tasks.

What Problem Does This Paper Address?

Molecular modeling, particularly in drug discovery, heavily relies on understanding the structure and properties of chemical compounds. While Graph Neural Networks (GNNs) have shown great success in this domain, they often overlook a crucial structural feature: rings. Over 90% of organic compounds contain at least one ring, and these rings play a significant role in a molecule's flexibility, conformation, and biological activity. Existing GNNs, which primarily focus on atoms and bonds, fail to fully leverage this important information, potentially limiting their predictive power. This paper addresses this gap by proposing a GNN that explicitly incorporates ring priors into its modeling process.

Methods

The core innovation is the development of π’ͺ-GNN (pronounced "O-GNN"), a ring-enhanced GNN. Unlike traditional GNNs, π’ͺ-GNN introduces latent representations for rings, which are iteratively updated alongside atom and bond representations. The architecture consists of multiple layers, where each layer updates edge, node, and ring representations by aggregating neighborhood information. The model utilizes self-attention for adaptive message passing and feed-forward layers for non-linearity. Theoretical analysis suggests that π’ͺ-GNN is more expressive than standard GNNs, capable of distinguishing isomorphic subgraphs on different rings with a single layer, a task that would require multiple layers for conventional GNNs.

Datasets

The paper evaluates π’ͺ-GNN on several datasets across three tasks:

  • Molecular Property Prediction:
    • PCQM4Mv1: Predicting the HOMO-LUMO energy gap.
  • MoleculeNet: Six datasets for predicting various pharmaceutical properties (BBBP, Tox21, ClinTox, HIV, BACE, SIDER).
  • FS-Mol: A few-shot molecular property prediction dataset.
  • Drug-Drug Interaction (DDI) Prediction:
    • DrugBank: A dataset for predicting interactions between drug molecules.
  • Retrosynthesis:
    • USPTO-50k: A dataset for predicting reactants of a given product.

Key Insights and Ideas

  • Rings are Crucial: The paper strongly emphasizes that ring structures are not just decorative but fundamental to molecular properties and interactions, and their explicit modeling significantly boosts performance.
  • Enhanced Expressiveness: π’ͺ-GNN's ability to distinguish isomorphic subgraphs on different rings with a single layer highlights its superior expressiveness compared to standard GNNs, which require more layers for the same task.
  • Parameter Efficiency: For tasks requiring the discrimination of complex substructures (large k-neighborhoods), π’ͺ-GNN can be more parameter-efficient than standard GNNs that rely on increasing depth.
  • Improved Convergence: π’ͺ-GNN demonstrates faster convergence compared to its ring-agnostic counterpart, suggesting that incorporating ring information leads to a more efficient learning process.

Key Results

π’ͺ-GNN achieved state-of-the-art results on several benchmarks:

  • PCQM4Mv1: Achieved the best validation Mean Absolute Error (MAE), outperforming the previous KDDCup champion solution.
  • Drug-Drug Interaction Prediction (DrugBank): Achieved state-of-the-art performance across accuracy, AUROC, AP, and F1 score.
  • Molecular Property Prediction (MoleculeNet): Outperformed conventional GNN baselines (GCN, GIN) and even some pre-training methods.
  • Retrosynthesis (USPTO-50k): Significantly boosted accuracy when combined with the LocalRetro framework, especially for molecules with more rings.

The paper also showed that incorporating ring information consistently improved performance across various molecular properties and ring complexities.

Limitations and Future Work

  • Over-smoothing: While the authors argue their model doesn't necessarily suffer from over-smoothing due to its architecture and successful training of deep networks, it remains a general concern for deep GNNs.
  • k-Neighborhood Complexity: Explicitly modeling k-neighborhoods can lead to a large number of parameters, and determining the optimal 'k' is challenging. π’ͺ-GNN offers a more parameter-efficient alternative for such tasks.
  • Invariant Constraints: While atom and bond features are invariant, the paper notes that variant features like coordinates are not encoded.
  • Future Work: The authors plan to combine π’ͺ-GNN with pre-training techniques for even stronger performance. They also aim to improve performance on few-shot learning scenarios and explore more complex structural representations. Applying the model to real-world applications like the synthesis of natural products with large rings is also a future direction.

Summary updated

Abstract

Cyclic compounds that contain at least one ring play an important role in drug design. Despite the recent success of molecular modeling with graph neural networks (GNNs), few models explicitly take rings in compounds into consideration, consequently limiting the expressiveness of the models. In this work, we design a new variant of GNN, ring-enhanced GNN ($\mathcal{O}$-GNN), that explicitly models rings in addition to atoms and bonds in compounds. In $\mathcal{O}$-GNN, each ring is represented by a latent vector, which contributes to and is iteratively updated by atom and bond representations. Theoretical analysis shows that $\mathcal{O}$-GNN is able to distinguish two isomorphic subgraphs lying on different rings using only one layer while conventional graph convolutional neural networks require multiple layers to distinguish, demonstrating that $\mathcal{O}$-GNN is more expressive. Through experiments, $\mathcal{O}$-GNN shows good performance on $\bf{11}$ public datasets. In particular, it achieves state-of-the-art validation result on the PCQM4Mv1 benchmark (outperforming the previous KDDCup champion solution) and the drug-drug interaction prediction task on DrugBank. Furthermore, $\mathcal{O}$-GNN outperforms strong baselines (without modeling rings) on the molecular property prediction and retrosynthesis prediction tasks.
BibTeX
@inproceedings{zhu2023o,
  author = {Jinhua Zhu and Kehan Wu and Bohan Wang and Yingce Xia and Shufang Xie and Qi Meng and Lijun Wu and Tao Qin and Wengang Zhou and Houqiang Li and Tie-Yan Liu},
  title = {{π’ͺ-GNN: incorporating ring priors into molecular modeling}},
  booktitle = {International Conference on Learning Representations},
  year = {2023},
  url = {https://openreview.net/forum?id=P0TuJi10fl},
}
Figure