Δ-ML Ensembles for Selecting Quantum Chemistry Methods to Compute Intermolecular Interactions

Austin M. Wallace, C. David Sherrill, Giri P. KrishnanarXiv 2025 · DOI · arXiv

Introduction

In quantum chemistry, calculating intermolecular interactions requires a delicate balance between accuracy and computational cost. The "gold standard" method, CCSD(T)/CBS, provides exceptional accuracy but scales at $O(N^7)$, making it prohibitively expensive for large-scale systems or high-throughput screening. Conversely, cheaper methods like Hartree-Fock (HF) or Density Functional Theory (DFT) are faster but often suffer from significant systematic errors. With hundreds of available "levels of theory" (combinations of methods and basis sets), researchers often struggle to select the most efficient method that meets specific accuracy requirements. This research introduces a framework to automate this choice by predicting the error of any given method using machine learning.

Methodology

The core of this approach is Delta-Machine Learning (Δ-ML). Rather than predicting total energy from scratch, Δ-ML models are trained to predict the difference (the "delta") between a low-level, computationally inexpensive method and a high-level reference.

Overview of the Δ-ML framework using AP-Net2 embeddings and an all-to-all ensemble to predict interaction energy differences across 80 levels of theory.

The framework utilizes AP-Net2 Embeddings, a pre-trained atom-pairwise neural network, to extract sophisticated molecular features. These features serve as inputs for an All-to-All Ensemble of models designed to map errors between 80 different levels of theory. This allows the system to predict how any method $A$ would perform relative to a target method $B$. To make the tool practical for real-world applications, the researchers also integrated polynomial compute-time estimators to predict the "wall time" for each method based on system size.

Datasets

The study leverages the BFDB-Ext (BioFragment Database Extended), a comprehensive dataset containing 3,816 dimers and approximately 250,000 quantum interaction energy computations. This includes reference data at both the "silver standard" [DW-CCSD(T**)-F12] and "gold standard" [CCSD(T)/CBS] levels, covering a wide range of chemical spaces including hydrogen-bonded and dispersion-bound complexes.

Results and Discussion

The Δ-ML framework demonstrated remarkable performance, achieving a Mean Absolute Error (MAE) of below 0.1 kcal/mol across all tested methods. This level of precision effectively brings even the most basic calculations up to "gold standard" accuracy.

(a) Error distributions for baseline methods vs. Δ-ML corrected versions. (b) Hierarchical clustering of levels of theory based on predicted errors.

As shown in the figure above, the transformation of cheap methods is significant. For instance, Hartree-Fock (HF) calculations, which initially had a baseline MAE of 2.89 kcal/mol, were corrected to just 0.08 kcal/mol. Similarly, the error for MP2/aug-cc-pVQZ was slashed from 0.21 kcal/mol to a mere 0.02 kcal/mol.

Beyond numerical accuracy, the model provided deep theoretical insights through Hierarchical Clustering. By analyzing predicted errors, the ML naturally grouped methods into a "family tree" that aligns with established theoretical physics. It correctly clustered different DFT functionals together while separating them from wavefunction-based methods, suggesting that the model captures the underlying physics of how these methods fail rather than simply memorizing data points.

Conclusion and Future Work

This ensemble framework serves as a powerful recommendation engine, allowing researchers to identify the computationally cheapest method that remains within a user-defined error tolerance. While currently trained on small organic dimers (up to 38 atoms), the high data efficiency gained from pre-trained embeddings suggests strong potential for generalization.

Future work will focus on expanding the framework to larger, more complex biomolecules and more diverse chemical spaces, such as organometallics. Additionally, the researchers aim to optimize the training of the "all-to-all" matrix by grouping similar methods to reduce the initial computational overhead of the ensemble.

Summary updated

Abstract

Ab initio quantum chemical methods for accurately computing interactions between molecules have a wide range of applications but are often computationally expensive. Hence, selecting an appropriate method based on accuracy and computational cost remains a significant challenge due to varying performance of methods. In this work, we propose a framework based on an ensemble of $Δ$-ML models trained on features extracted from a pre-trained atom-pairwise neural network to predict the error of each method relative to all other methods including the ``gold standard'' coupled cluster with single, double, and perturbative triple excitations at the estimated complete basis set limit [CCSD(T)/CBS]. Our proposed approach provides error estimates across various levels of theories and identifies the computationally efficient approach for a given error range utilizing only a subset of the dataset. Further, this approach allows comparison between various theories. We demonstrate the effectiveness of our approach using an extended BioFragment dataset, which includes the interaction energies for common biomolecular fragments and small organic dimers. Our results show that the proposed framework achieves very small mean-absolute-errors below 0.1 kcal/mol regardless of the given method. Furthermore, by analyzing all-to-all $Δ$-ML models for present levels of theory, we identify method groupings that align with theoretical hypotheses, providing evidence that $Δ$-ML models can easily learn corrections from any level of theory to any other level of theory.
BibTeX
@misc{wallace2025ml,
  author = {Austin M. Wallace and C. David Sherrill and Giri P. Krishnan},
  title = {{Δ-ML Ensembles for Selecting Quantum Chemistry Methods to Compute Intermolecular Interactions}},
  year = {2025},
  eprint = {2511.17753},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2511.17753},
}
Figure