Improving de novo molecular design with curriculum learning

Jeff Guo, Vendy Fialková, Juan Diego Arango, Christian Margreitter, Jon Paul Janet, Kostas Papadopoulos, Ola Engkvist, Atanas Patronov

Abstract

Reinforcement learning is a powerful paradigm that has gained popularity across multiple domains. However, applying reinforcement learning may come at the cost of multiple interactions between the agent and the environment. This cost can be especially pronounced when the single feedback from the environment is slow or computationally expensive, causing extensive periods of non-productivity. Curriculum learning provides a suitable alternative by arranging a sequence of tasks of increasing complexity, with the aim of reducing the overall cost of learning. Here we demonstrate the application of curriculum learning for drug discovery. We implement curriculum learning in the de novo design platform REINVENT, and apply it to illustrative molecular design problems of different complexities. The results show both accelerated learning and a positive impact on the quality of the output when compared with standard policy-based reinforcement learning.
BibTeX
@article{guo2022improving,
  author = {Jeff Guo and Vendy Fialková and Juan Diego Arango and Christian Margreitter and Jon Paul Janet and Kostas Papadopoulos and Ola Engkvist and Atanas Patronov},
  title = {{Improving de novo molecular design with curriculum learning}},
  journal = {Nat. Mach. Intell},
  year = {2022},
  doi = {10.1038/s42256-022-00494-4},
}
Figure