Attribute-guided prototype network for few-shot molecular property prediction

Linlin Hou, Hongxin Xiang, Xiangxiang Zeng, Dongsheng Cao, Li Zeng, Bosheng Song

Published in Briefings in Bioinformatics (2024), this research introduces the Attribute-guided Prototype Network (APN). The framework is designed to overcome the data scarcity limitations inherent in traditional molecular property prediction by leveraging high-level chemical attributes to guide deep learning models.

The Challenge of Few-Shot Molecular Property Prediction

Molecular Property Prediction (MPP) is a critical component of virtual screening in drug discovery. While deep learning has significantly advanced MPP, these models typically require thousands of labeled examples to achieve high accuracy. In practice, biological data for novel drug targets is often extremely limited, frequently consisting of only 10 to 20 molecules with known activity.

This "low-data" scenario is known as the Few-Shot Molecular Property Prediction (FS-MPP) problem. Current few-shot methods often rely exclusively on 2D graph structures (atoms and bonds). The authors posit that these models fail to capture the high-level chemical concepts—such as specific functional groups or physicochemical properties—that human experts use to generalize knowledge across molecular structures.

The APN Framework

The APN framework addresses these limitations through three integrated components:

  1. Molecular Attribute Extractor: This module generates high-level "concepts" for a molecule using two distinct sources: traditional hand-crafted fingerprints (14 types, including circular and path-based) and "Deep Attributes" extracted from state-of-the-art self-supervised models like Molformer and MoleBERT.
  2. Attribute-Guided Dual-channel Attention (AGDA): This core innovation uses extracted attributes to refine molecular representations at both the local (atom-level) and global (molecule-level) scales. It essentially teaches the model to focus on property-relevant features.
  3. Weighted Prototype Network: Unlike standard prototype networks that simply average support molecules, APN employs a distance-based weighting scheme. Molecules more representative of a cluster exert a stronger influence on the final "prototype" used for classification.
Figure 4: Detailed architecture of the APN framework, including the Attribute Extractor and the AGDA mechanism.

Key Insights and Empirical Results

The authors evaluated APN on standard benchmarks from MoleculeNet, including Tox21, SIDER, and MUV, as well as the Therapeutic Data Commons (TDC) for cross-domain generalization.

Attributes as a Semantic Bridge

Much like identifying a zebra by its "stripes," chemical attributes provide a common semantic language that helps the model identify toxic or active molecules even with minimal examples. The study found that path-based fingerprints (e.g., RDK5 and RDK6) often contributed more to performance gains than circular fingerprints like ECFP.

Figure 6: ROC-AUC performance comparison across different molecular attributes, highlighting the effectiveness of path-based features (rdk5, rdk6) over the baseline (none).

Performance Gains

APN consistently outperformed existing baselines such as MetaGAT and IterRefLSTM. Key results include:

  • State-of-the-Art Accuracy: APN achieved the highest ROC-AUC scores on Tox21 and MUV in both 5-shot and 10-shot scenarios.
  • Quantitative Improvements: The model demonstrated average improvements of 1.69% in ROC-AUC and 1.89% in Precision-Recall AUC over the best-performing baselines.
  • Robust Generalization: On the TDC dataset, APN showed a ~7% improvement in ROC-AUC over MetaGAT, proving its ability to generalize to entirely unseen classes of molecules.

Limitations and Future Directions

While effective, the computational complexity of processing "triplet" attributes (combinations of three fingerprints) suggests a trade-off between efficiency and accuracy. Future research may explore automated multi-attribute fusion or the use of Large Language Models (LLMs) to extract attributes from textual molecular descriptions. Additionally, extending the framework from binary classification to multi-class classification and regression remains an open area for exploration.

Summary updated

Abstract

The molecular property prediction (MPP) plays a crucial role in the drug discovery process, providing valuable insights for molecule evaluation and screening. Although deep learning has achieved numerous advances in this area, its success often depends on the availability of substantial labeled data. The few-shot MPP is a more challenging scenario, which aims to identify unseen property with only few available molecules. In this paper, we propose an attribute-guided prototype network (APN) to address the challenge. APN first introduces an molecular attribute extractor, which can not only extract three different types of fingerprint attributes (single fingerprint attributes, dual fingerprint attributes, triplet fingerprint attributes) by considering seven circular-based, five path-based, and two substructure-based fingerprints, but also automatically extract deep attributes from self-supervised learning methods. Furthermore, APN designs the Attribute-Guided Dual-channel Attention module to learn the relationship between the molecular graphs and attributes and refine the local and global representation of the molecules. Compared with existing works, APN leverages high-level human-defined attributes and helps the model to explicitly generalize knowledge in molecular graphs. Experiments on benchmark datasets show that APN can achieve state-of-the-art performance in most cases and demonstrate that the attributes are effective for improving few-shot MPP performance. In addition, the strong generalization ability of APN is verified by conducting experiments on data from different domains.
BibTeX
@article{hou2024attribute,
  author = {Linlin Hou and Hongxin Xiang and Xiangxiang Zeng and Dongsheng Cao and Li Zeng and Bosheng Song},
  title = {{Attribute-guided prototype network for few-shot molecular property prediction}},
  journal = {Briefings in Bioinformatics},
  year = {2024},
  doi = {10.1093/bib/bbae394},
}
Figure