Gaussian Process-Based Refinement of Dispersion Corrections

Jonny Proppe, Stefan Gugler, Markus ReiherJournal of Chemical Theory and Computation 2019 · DOI · arXiv

Abstract

We employ Gaussian process (GP) regression to adjust for systematic errors in D3-type dispersion corrections, resulting in a statistically improved model termed D3-GP. The model is trained on the differences between interaction energies obtained from PBE-D3(BJ)/ma-def2-QZVPP and high-level DLPNO-CCSD(T)/CBS calculations. Using a data set of 1,248 molecular dimers representing dispersion-dominated systems, we demonstrate that a reparametrized D3(BJ) model with a single empirical parameter ($a_2 = 5.6841$ bohr) outperforms existing parameter sets. To facilitate learning, we engineered two vectorial representations derived from the D3(BJ) interaction matrix: a distance-resolved interaction energy histogram (histD3(BJ)) and ordered eigenvalues (eigD3(BJ)). Furthermore, we introduce Batchwise Variance-Based Sampling (BVS), an active-learning scheme that utilizes GP prediction variance to select optimal training subsets. This approach yields a self-improving workflow capable of predicting system-focused, refined dispersion corrections with high efficiency.

Introduction

Density Functional Theory (DFT) is a cornerstone of modern computational chemistry, yet it fundamentally struggles to account for London dispersion interactions. These weak, long-range attractive forces are critical for the stability and structure of many molecular systems. To address this, empirical "patches" like the D3(BJ) dispersion correction are commonly applied. While computationally efficient and physically grounded, these corrections often suffer from inherent model inadequacy, failing to perfectly replicate high-level quantum chemical results. The goal of this work is to bridge the gap between cheap, approximate methods and "gold standard" reference calculations like CCSD(T) by using machine learning to learn and correct the systematic errors of the D3 model.

Methods

The D3-GP approach treats the error of the D3 model as a residual to be learned via Gaussian Process regression, a technique known as $\Delta$-learning.

Reparametrization of D3(BJ)

Analysis of dispersion-dominated systems revealed that the standard D3(BJ) model might be over-parameterized for specific chemical domains. By setting the empirical parameters $a_1$ and $s_8$ to zero and optimizing the remaining parameter $a_2$, we achieved superior performance for the target systems compared to universal parameter sets. This simplified model serves as the baseline for further GP refinement.

Feature Engineering

To represent molecular systems without the complexities of raw atomic coordinates, we developed two descriptors based directly on the D3 interaction matrix:

  • histD3(BJ): A histogram of atom-pairwise interaction energies, resolved by distance.
  • eigD3(BJ): The eigenvalues of the interaction matrix, ordered by absolute value. These descriptors ensure the model remains "physics-informed" by mapping directly from D3 information, making the correction comparable to the original approach.

Batchwise Variance-Based Sampling (BVS)

Active learning is central to the D3-GP workflow. By leveraging the uncertainty (variance) provided by the GP, the BVS algorithm identifies batches of molecular configurations where the model is most uncertain. These points are then prioritized for expensive reference calculations, maximizing the information gain per calculation and allowing the model to "self-improve" efficiently.

Data Sets

The study utilized a comprehensive collection of 1,248 molecular dimers, categorized into three primary sets to test different aspects of the model's performance, including equilibrium structures and various relative orientations.

Table 1: Overview of the molecular dimer data sets used for training and validation.

The S13x8 set provides a benchmark for dispersion-dominated systems at various distances, while the ROTA and CONF sets explore the effects of relative orientation and internal molecular conformation of ethyne–pentane dimers, respectively.

Key Results and Discussion

The D3-GP model demonstrates significant improvements over standard dispersion corrections. The reparametrized D3 model alone reduced the Mean Absolute Relative Error (MARE) on the S13x8-V set from 13.4% (using standard Grimme parameters) to 8.2%. When combined with GP refinement, the model exhibits a steep learning curve, often outperforming standard D3 after seeing fewer than five training examples for specific systems.

The BVS strategy proved highly efficient, reaching accuracy thresholds (e.g., 0.05 kcal/mol) with far fewer data points than random sampling. Among the descriptors, histD3(BJ) generally provided more stable learning and lower prediction errors. However, challenges remain in extrapolation; while the model excels at interpolation within its training domain, its performance on chemically diverse systems outside that domain shows more modest improvements, suggesting that training set selection is critical.

Conclusion

D3-GP represents a shift toward self-improving computational tools in quantum chemistry. By integrating physics-based models with active-learning-driven machine learning, we can achieve high-level accuracy at a fraction of the cost of traditional "gold standard" methods. Future developments will focus on expanding the model's domain to include more diverse interactions, such as hydrogen bonding, and establishing a community-driven database for continuous model refinement.

Summary updated

Abstract

We employ Gaussian process (GP) regression to adjust for systematic errors in D3-type dispersion corrections. We refer to the associated, statistically improved model as D3-GP. It is trained on differences between interaction energies obtained from PBE-D3(BJ)/ma-def2-QZVPP and DLPNO-CCSD(T)/CBS calculations. We generated a data set containing interaction energies for 1248 molecular dimers, which resemble the dispersion-dominated systems contained in the S66 data set. Our systems represent not only equilibrium structures but also dimers with various relative orientations and conformations at both shorter and longer distances. A reparametrization of the D3(BJ) model based on 66 of these dimers suggests that two of its three empirical parameters, <i>a</i><sub>1</sub> and <i>s</i><sub>8</sub>, are zero, whereas <i>a</i><sub>2</sub> = 5.6841 bohr. For the remaining 1182 dimers, we find that this new set of parameters is superior to all previously published D3(BJ) parameter sets. To train our D3-GP model, we engineered two different vectorial representations of (supra-)molecular systems, both derived from the matrix of atom-pairwise D3(BJ) interaction terms: (a) a distance-resolved interaction energy histogram, histD3(BJ), and (b) eigenvalues of the interaction matrix ordered according to their decreasing absolute value, eigD3(BJ). Hence, the GP learns a mapping from D3(BJ) information only, which renders D3-GP-type dispersion corrections comparable to those obtained with the original D3 approach. They improve systematically if the underlying training set is selected carefully. Here, we harness the prediction variance obtained from GP regression to select optimal training sets in an automated fashion. The larger the variance, the more information the corresponding data point may add to the training set. For a given set of molecular systems, variance-based sampling can approximately determine the smallest subset being subjected to reference calculations such that all dispersion corrections for the remaining systems fall below a predefined accuracy threshold. To render the entire D3-GP workflow as efficient as possible, we present an improvement over our variance-based, sequential active-learning scheme [ <i>J. Chem. Theory Comput.</i> 2018 , 14 , 5238 ]. Our refined learning algorithm selects multiple (instead of single) systems that can be subjected to reference calculations simultaneously. We refer to the underlying selection strategy as batchwise variance-based sampling (BVS). BVS-guided active learning is an essential component of our D3-GP workflow, which is implemented in a black-box fashion. Once provided with reference data for new molecular systems, the underlying GP model automatically learns to adapt to these and similar systems. This approach leads overall to a self-improving model (D3-GP) that predicts system-focused and GP-refined D3-type dispersion corrections for any given system of reference data.
BibTeX
@article{proppe2019gaussian,
  author = {Jonny Proppe and Stefan Gugler and Markus Reiher},
  title = {{Gaussian Process-Based Refinement of Dispersion Corrections}},
  journal = {Journal of Chemical Theory and Computation},
  year = {2019},
  doi = {10.1021/acs.jctc.9b00627},
}
Figure