Optimizing Molecules using Efficient Queries from Property Evaluations

Samuel Hoffman, Vijil Chenthamarakshan, Kahini Wadhawan, Pin-Yu Chen, Payel Das

TL;DR

QMO (Query-based Molecule Optimization) is a new framework that uses zeroth-order optimization to navigate the latent space of molecular autoencoders, allowing researchers to improve chemical properties using only "black-box" evaluations. By decoupling representation learning from property search, QMO achieves state-of-the-art results in drug-likeness benchmarks and successfully optimizes real-world leads for SARS-CoV-2 inhibition and non-toxic antimicrobial peptides.

What Problem Does This Paper Address?

Molecule Optimization (MO) is the process of taking a "lead" molecule and tweaking its structure to improve specific properties—like making a drug more soluble or a peptide less toxic—while keeping its core functionality intact. This is notoriously difficult because the space of possible molecules is astronomically large and discrete (represented as strings or graphs).

Existing machine learning approaches often struggle with two things:

  1. Differentiability: Many high-quality property evaluators (like physics-based simulators or proprietary APIs) are "black boxes" that don't provide gradients, making standard gradient-based optimization impossible.
  2. Data Scarcity: Some methods require large sets of "paired" data (examples of a molecule before and after optimization), which rarely exist for novel targets like SARS-CoV-2.

Methods

QMO addresses these challenges by combining a pre-trained autoencoder with Zeroth-Order (ZO) Optimization.

  1. Latent Space Mapping: QMO uses a pre-trained autoencoder to map discrete molecular representations (like SMILES strings for small molecules or amino acid sequences for peptides) into a continuous, low-dimensional latent space.
  2. Zeroth-Order Gradient Estimation: Instead of requiring a differentiable property model, QMO estimates the "direction of improvement" by randomly sampling small perturbations around a candidate molecule's latent vector. It decodes these samples, queries the property evaluator, and uses the resulting scores to estimate a pseudo-gradient.
  3. Iterative Refinement: The system uses a zeroth-order version of the Adam optimizer to progressively move the latent vector toward regions that satisfy user-defined constraints (e.g., "binding affinity > 7.5") while maximizing similarity to the original lead.
Figure 1. System illustration of the proposed query-based molecule optimization (QMO) framework. The QMO system progressively optimizes an input lead molecule (e.g., Remdesivir) according to a set of user-specified properties (e.g., binding affinity and Tanimoto similarity) by leveraging the learned molecule embeddings from a pair of pre-trained encoder and decoder (i.e. an autoencoder), and by evaluating the properties of the generated molecules. Given a candidate embedding zt at the optimization step t, QMO randomly samples the neighboring vectors of zt in the embedding space, evaluates the properties of the corresponding decoded molecules, and uses the evaluations for gradient estimation (see equation (4)) and queried-based gradient descent (see equation (3)) for finding the next candidate embedding vector zt+1.

Datasets

The authors evaluated QMO across three distinct areas:

  • Standard Benchmarks: 800 molecules from the ZINC dataset were used to test optimization for drug-likeness (QED) and solubility (penalized logP).
  • SARS-CoV-2 Mpro Inhibitors: A set of 23 existing molecules known to have weak-to-moderate affinity for the SARS-CoV-2 Main Protease (including Remdesivir and Dipyridamole).
  • Antimicrobial Peptides (AMPs): 150 experimentally verified toxic AMPs collected from public databases, aimed at reducing toxicity while maintaining antimicrobial activity.

Key Insights and Ideas

  • Decoupling is Key: By separating the task of learning what a molecule looks like (autoencoder) from learning what a molecule does (property evaluation), QMO can use any pre-trained model as a "plug-in."
  • Black-Box Compatibility: Because it only requires function evaluations (queries), QMO can work with virtually any external simulator, lab result, or statistical model without needing to know its internal architecture.
  • Preserving the "Lead": The framework is specifically designed to stay close to the starting molecule. This is crucial in drug discovery, where you want to leverage existing manufacturing pipelines and safety data of known compounds.
  • Efficiency through Latent Search: Searching in a continuous 512-dimensional latent space is vastly more efficient than trying to navigate the combinatorial explosion of discrete chemical sequences.

Key Results

QMO demonstrated significant performance gains over existing translation-based and search-based methods:

  • State-of-the-Art Benchmarks: On the QED drug-likeness task, QMO achieved a 92.8% success rate, outperforming the best baseline by over 15%. For solubility (logP), it showed an absolute improvement of 7.71, nearly 2 points higher than the next best method.
  • SARS-CoV-2 Optimization: QMO successfully optimized all 23 lead inhibitors to meet high-affinity thresholds. For example, it improved the binding free energy of a Dipyridamole variant from -11.49 to -25.65 kcal/mol while maintaining a 0.58 Tanimoto similarity.
Figure 2. Top docking poses of Dipyridamole and its QMO-optimized variant with SARS-CoV-2 Mpro, as obtained using AutoDock Vina. Their 2D structures are also shown. QMO optimizes the predicted affinity for the Dipyridamole variant from 3.94 to 7.59, while maintaining a Tanimoto similarity score of 0.58 and without changing the binding pocket significantly. MM/PBSA calculations for these poses show binding free energy improvement from −11.49 to −25.65 kcal/mol. Important residues from Mpro substrate-binding pocket are also shown. See Table 5 in the Supplementary Material for details.
  • Non-Toxic AMPs: The framework successfully optimized 72.6% of toxic antimicrobial peptides into non-toxic variants. Analysis showed these improvements were linked to a consistent lowering of hydrophobicity and hydrophobic moments, which are known drivers of toxicity.
Cumulative success rate of AMP optimization

Limitations and Future Work

While powerful, QMO's reliance on zeroth-order optimization means it requires a high number of queries per iteration (the authors used $Q=10$ to $Q=100$ random directions). This can be computationally expensive if the property evaluator is a slow physics-based simulation.

The authors suggest that future work could involve multi-fidelity optimization, where fast, cheap models provide the bulk of the guidance, and expensive, high-accuracy simulations (or even human expert feedback) are queried only sparingly to refine the final candidates. They also note that the quality of the optimization is heavily dependent on the quality of the underlying latent space learned by the autoencoder.

Summary updated

Abstract

Machine learning based methods have shown potential for optimizing existing molecules with more desirable properties, a critical step towards accelerating new chemical discovery. Here we propose QMO, a generic query-based molecule optimization framework that exploits latent embeddings from a molecule autoencoder. QMO improves the desired properties of an input molecule based on efficient queries, guided by a set of molecular property predictions and evaluation metrics. We show that QMO outperforms existing methods in the benchmark tasks of optimizing small organic molecules for drug-likeness and solubility under similarity constraints. We also demonstrate significant property improvement using QMO on two new and challenging tasks that are also important in real-world discovery problems: (i) optimizing existing potential SARS-CoV-2 Main Protease inhibitors toward higher binding affinity; and (ii) improving known antimicrobial peptides towards lower toxicity. Results from QMO show high consistency with external validations, suggesting effective means to facilitate material optimization problems with design constraints.
BibTeX
@article{hoffman2022optimizing,
  author = {Samuel Hoffman and Vijil Chenthamarakshan and Kahini Wadhawan and Pin-Yu Chen and Payel Das},
  title = {{Optimizing Molecules using Efficient Queries from Property Evaluations}},
  journal = {Nat. Mach. Intell.},
  year = {2022},
  doi = {10.1038/s42256-021-00422-y},
}
Figure