Feature functional theory - binding predictor (FFT-BP) for the blind prediction of binding free energies.

Bao Wang, Zhixiong Zhao, Duc D. Nguyen, Guo-Wei WeiarXiv 2017 · OpenReview

TL;DR

This paper introduces FFT-BP, a novel method for predicting protein-ligand binding affinities. By combining physics-based microscopic features with machine learning, FFT-BP achieves competitive accuracy in blind prediction tasks, offering a robust approach to a critical challenge in drug discovery.

What Problem Does This Paper Address?

Designing new drugs is a complex, lengthy, and expensive process. A crucial step is predicting how strongly a potential drug molecule (ligand) will bind to its target protein. Accurate prediction of this "binding affinity" is essential for virtual screening, which aims to identify promising drug candidates early on. However, developing accurate scoring functions that can reliably predict binding affinities for diverse protein-ligand pairs remains a significant challenge in computational biosciences. Existing methods often struggle with generalization across different protein targets or require extensive parameterization. This paper aims to address this by developing a more robust and accurate prediction method.

Methods

The core of the FFT-BP approach lies in its "Feature Functional Theory" (FFT). This theory is built on three key assumptions:

  1. Representability: Every protein-ligand complex can be uniquely characterized by a microscopic feature vector.
  2. Feature-Function Relationship: Macroscopic properties (like binding free energy) are a functional of these microscopic feature vectors.
  3. Similarity: Complexes with similar microscopic features will have similar macroscopic properties (binding affinities).

To extract these microscopic features, the authors leverage established physical models, including:

  • Implicit Solvent Models (Poisson-Boltzmann theory): Used to capture electrostatic interactions and solvation effects.
  • Molecular Mechanics: To account for van der Waals interactions.
  • Atomic Surface Areas and Molecular Volume: To represent hydrophobic and entropy effects.

These features are then fed into a machine learning algorithm, specifically a Multiple Additive Regression Tree (MART) algorithm, which is a type of gradient boosting decision tree. MART is used to learn the complex, non-linear relationship between the extracted features and the binding free energy, effectively ranking the importance of different features and predicting the affinity. The method also employs a Tikhonov regularization technique to prevent overfitting during training.

Datasets

The study utilizes several well-established datasets for training and validation:

  • Validation Set (N=1322): A subset of the PDBBind v2015 refined set, used to explore cluster dependence and optimal feature extraction cut-off distances.
  • Training Set (N=3589): Derived from the PDBBind v2015 refined set, used for training the FFT-BP model.
  • Test Sets:
    • Benchmark Set (N=100): A commonly used set for evaluating scoring functions.
  • PDBBind v2007 core set (N=195): A benchmark set known for its high-quality data.
  • PDBBind v2015 core set (N=195): Another high-quality benchmark set, similar to the v2013 and v2014 core sets.

The authors also mention using a PDBBind v2007 refined set (N=1082) for training when testing on the PDBBind v2007 core set to avoid overlap.

Key Insights and Ideas

  • Physics-informed features are crucial: The success of FFT-BP hinges on extracting meaningful microscopic features from established physical models. This bridges the gap between purely empirical methods and computationally intensive quantum mechanical approaches.
  • Machine learning for complex relationships: The use of MART (a gradient boosting algorithm) is key to capturing the non-linear and non-additive nature of binding affinities, which simpler linear models often miss.
  • Robustness across diverse targets: The validation on multiple clusters and blind prediction tests suggests that FFT-BP can generalize well to different protein targets, a common weakness in many scoring functions.
  • Feature importance is learned: The LTR approach automatically ranks feature importance, allowing the model to focus on the most predictive features and potentially reducing the dimensionality of the problem.

Key Results

FFT-BP demonstrates competitive performance across various benchmark datasets:

  • Validation Set (N=1322): Achieved an RMSE of 1.55-1.59 kcal/mol and a Pearson correlation of 0.80.
  • Training Set (N=3589): Achieved an RMSE of 1.98 kcal/mol with optimal parameters.
  • Benchmark Set (N=100): Achieved an RMSE of 1.99 kcal/mol and a Pearson correlation of 0.75.
  • PDBBind v2007 core set (N=195): Achieved an RMSE of 2.03 kcal/mol and a Pearson correlation of 0.80.
  • PDBBind v2015 core set (N=195): Achieved an RMSE of 1.92 kcal/mol and a Pearson correlation of 0.78.

These results are comparable to or better than many existing scoring functions, particularly in blind prediction scenarios. The study also found that an optimal cut-off distance of 12 Å for feature extraction yielded the best results.

Limitations and Future Work

The authors acknowledge several limitations and suggest future directions:

  • Force Field Simplification: The current model uses a "crude force field" for the Poisson model. More accurate Poisson-Boltzmann modeling, including polarizable models, could improve results.
  • QM/MM Integration: Incorporating features derived from more accurate quantum mechanics/molecular mechanics (QM/MM) models is a promising avenue.
  • Advanced Machine Learning: Exploring more sophisticated machine learning algorithms, such as deep learning, could further enhance prediction accuracy and potentially eliminate prediction bias.
  • Metal Effects: The current model neglects metal effects in protein-ligand binding, which is a known limitation. Incorporating this aspect is a key area for future investigation.
  • Prediction Bias: While generally robust, the authors note that predictions can be biased, and further work is needed to address this.

Summary updated

Abstract

We present a feature functional theory - binding predictor (FFT-BP) for the protein-ligand binding affinity prediction. The underpinning assumptions of FFT-BP are as follows: i) representability: there exists a microscopic feature vector that can uniquely characterize and distinguish one protein-ligand complex from another; ii) feature-function relationship: the macroscopic features, including binding free energy, of a complex is a functional of microscopic feature vectors; and iii) similarity: molecules with similar microscopic features have similar macroscopic features, such as binding affinity. Physical models, such as implicit solvent models and quantum theory, are utilized to extract microscopic features, while machine learning algorithms are employed to rank the similarity among protein-ligand complexes. A large variety of numerical validations and tests confirms the accuracy and robustness of the proposed FFT-BP model. The root mean square errors (RMSEs) of FFT-BP blind predictions of a benchmark set of 100 complexes, the PDBBind v2007 core set of 195 complexes and the PDBBind v2015 core set of 195 complexes are 1.99, 2.02 and 1.92 kcal/mol, respectively. Their corresponding Pearson correlation coefficients are 0.75, 0.80, and 0.78, respectively.
BibTeX
@misc{wang2017feature,
  author = {Bao Wang and Zhixiong Zhao and Duc D. Nguyen and Guo-Wei Wei},
  title = {{Feature functional theory - binding predictor (FFT-BP) for the blind prediction of binding free energies.}},
  year = {2017},
  eprint = {1703.10927},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1703.10927},
}
Figure