FCHL revisited: Faster and more accurate quantum machine learning

Anders S. Christensen, Lars Andersen Bratholm, Felix A. Faber, O. Anatole von LilienfeldThe Journal of Chemical Physics 2020 · DOI

TL;DR

This paper introduces FCHL19, a significantly faster and more accurate quantum machine learning representation for atomic environments. By discretizing and rigorously optimizing features, FCHL19 enables predictions of molecular energies and forces with chemical accuracy in milliseconds, making it practical for general chemistry and molecular dynamics simulations.

What Problem Does This Paper Address?

The field of quantum machine learning (QML) aims to accelerate chemical simulations by training models to predict molecular properties like energies and forces. While previous QML models, including the authors' own FCHL18, achieved high accuracy, their computational cost was a significant bottleneck, hindering their widespread adoption for large-scale simulations or general chemistry tasks. Specifically, the computational expense of evaluating the representation and the subsequent kernel calculations limited their applicability. This paper addresses this by developing a new representation, FCHL19, that is both computationally efficient and highly accurate, aiming to bridge the gap between theoretical accuracy and practical usability.

Methods

The core innovation is the FCHL19 representation, a revision of the FCHL18 model. Key methodological advancements include:

  • Discretization of Features: Unlike FCHL18 which solved analytical integrals, FCHL19 discretizes its features into bins. This significantly speeds up evaluation.
  • Rigorous Hyperparameter Optimization: A Monte Carlo optimization procedure was used to find a set of "universal" hyperparameters for the representation. This aims to provide good performance across various datasets without requiring re-optimization for each new problem.
  • Elemental Screening in Kernel: A Gaussian kernel function is employed, augmented with an elemental screening function. This ensures that only representations of atoms of the same element type are compared, further reducing computational cost.
  • Integration with QML Regressors: FCHL19 is tested with several kernel-based machine learning regressors, including Kernel Ridge Regression (KRR), Operator Quantum Machine Learning (OQML), Gaussian Process Regression (GPR), and Gradient-Domain Machine Learning (GDML). The paper highlights the speed and accuracy benefits when FCHL19 is combined with OQML for force and energy predictions.

Datasets

The paper utilizes several established datasets for training and evaluation:

  • QM7b: A dataset of 7,211 molecules with up to 7 atoms (CNOSCI), used for atomization energy predictions.
  • QM9: A larger dataset of 133,885 molecules with up to 9 atoms (CNOF), also used for atomization energy predictions.
  • QM7b-T and GDB13-T: Datasets containing non-equilibrium geometries, used to test the extrapolative capabilities of the models.
  • Water40: A dataset of 10,000 MD snapshots of a 40-water molecule cluster, used to evaluate performance on condensed-phase systems and non-bonded interactions.
  • MD17: A dataset containing snapshots from ab initio molecular dynamics for seven small organic molecules, used for force and energy learning.

Key Insights and Ideas

  • Discretization is Key for Speed: The shift from analytical integrals to discretized features in FCHL19 is the primary driver of its significant speedup.
  • Universal Hyperparameters Work: The success of a single set of "universal" hyperparameters across diverse datasets suggests a high degree of transferability in the FCHL19 representation. This greatly simplifies its application.
  • Elemental Screening is Efficient: The kernel's elemental screening significantly reduces computational cost without sacrificing accuracy, especially for systems with diverse elements.
  • OQML + FCHL19 = Millisecond Predictions: The combination of FCHL19 with the OQML regressor achieves state-of-the-art accuracy for forces and energies with prediction times in the milliseconds per atom range, a major breakthrough for practical QML applications.
  • Transferability Beyond Small Molecules: The representation, optimized for small molecules, shows excellent performance on larger systems like water clusters, indicating its robustness.

Key Results

  • Speed: FCHL19 models, particularly when paired with OQML, can predict energies and forces in milliseconds per atom. This represents a speedup of 10-20 times compared to FCHL18/OQML for energy learning and 2-4 times for force learning. Kernel evaluation times are also drastically reduced (e.g., 27 hours for QM9 with FCHL19 vs. 728 hours with aSLATM on the same hardware).
  • Accuracy: FCHL19 models achieve state-of-the-art accuracy on QM7b and QM9 datasets, with MAE values of 0.25 kcal/mol for QM9 at large training sizes. For the Water40 dataset, the MAE binding energy error is less than 0.1 kcal/mol/molecule. On the MD17 dataset, FCHL19 models show improved accuracy and faster learning compared to FCHL18.
  • Condensed Phase Performance: FCHL19 demonstrates superior accuracy for binding energies in water clusters, highlighting its effectiveness for non-bonded interactions.

Limitations and Future Work

  • Dataset Dependence: While universal parameters are presented, the authors acknowledge that for optimal learning on a specific dataset, re-fitting parameters might still be beneficial.
  • Noise in MD17: The energy prediction accuracy on the MD17 dataset appears to be limited by noise in the DFT energies, rather than the model's capability.
  • Symmetry in Molecules: For molecules with high symmetry (e.g., rings), the performance of FCHL variants might be slower, suggesting potential for re-optimization for such systems.
  • Future Work: The authors envision FCHL19 as a valuable tool for general chemistry problems and molecular dynamics simulations. They also suggest that future work could explore global representations for even greater computational efficiency, though current global representations show lower accuracy. The development of transferable models for computational materials science is also a key future direction.

Summary updated

Abstract

We introduce the FCHL19 representation for atomic environments in molecules or condensed-phase systems. Machine learning models based on FCHL19 are able to yield predictions of atomic forces and energies of query compounds with chemical accuracy on the scale of milliseconds. FCHL19 is a revision of our previous work [F. A. Faber et al., J. Chem. Phys. 148, 241717 (2018)] where the representation is discretized and the individual features are rigorously optimized using Monte Carlo optimization. Combined with a Gaussian kernel function that incorporates elemental screening, chemical accuracy is reached for energy learning on the QM7b and QM9 datasets after training for minutes and hours, respectively. The model also shows good performance for non-bonded interactions in the condensed phase for a set of water clusters with a mean absolute error (MAE) binding energy error of less than 0.1 kcal/mol/molecule after training on 3200 samples. For force learning on the MD17 dataset, our optimized model similarly displays state-of-the-art accuracy with a regressor based on Gaussian process regression. When the revised FCHL19 representation is combined with the operator quantum machine learning regressor, forces and energies can be predicted in only a few milliseconds per atom. The model presented herein is fast and lightweight enough for use in general chemistry problems as well as molecular dynamics simulations.
BibTeX
@article{christensen2020fchl,
  author = {Anders S. Christensen and Lars Andersen Bratholm and Felix A. Faber and O. Anatole von Lilienfeld},
  title = {{FCHL revisited: Faster and more accurate quantum machine learning}},
  journal = {The Journal of Chemical Physics},
  year = {2020},
  doi = {10.1063/1.5126701},
}
Figure