RediscMol: Benchmarking Molecular Generation Models in Biological Properties

Gaoqi Weng, Huifeng Zhao, Dou Nie, Haotian Zhang, Liwei Liu, Tingjun Hou, Yu KangJournal of Medicinal Chemistry 2024 · DOI

Abstract

Deep learning-based molecular generative models have garnered emerging attention for their capability to generate molecules with novel structures and desired physicochemical properties. However, the evaluation of these models, particularly in a biological context, remains insufficient. To address the limitations of existing metrics and emulate practical application scenarios, we construct the RediscMol benchmark that comprises active molecules extracted from 5 kinase and 3 GPCR data sets. A set of rediscovery- and similarity-related metrics are introduced to assess the performance of 8 representative generative models (CharRNN, VAE, Reinvent, AAE, ORGAN, RNNAttn, TransVAE, and GraphAF). Our findings based on the RediscMol benchmark differ from those of previous evaluations. CharRNN, VAE, and Reinvent exhibit a greater ability to reproduce known active molecules, while RNNAttn, TransVAE, and GraphAF struggle in this aspect despite their notable performance on commonly used distribution-learning metrics. Our evaluation framework may provide valuable guidance for advancing generative models in real-world drug design scenarios.
BibTeX
@article{weng2024rediscmol,
  author = {Gaoqi Weng and Huifeng Zhao and Dou Nie and Haotian Zhang and Liwei Liu and Tingjun Hou and Yu Kang},
  title = {{RediscMol: Benchmarking Molecular Generation Models in Biological Properties}},
  journal = {Journal of Medicinal Chemistry},
  year = {2024},
  doi = {10.1021/acs.jmedchem.3c02051},
}

Loading related content...

Figure