Multi-scale approach for the prediction of atomic scale properties

Andrea Grisafi, Jigyasa Nigam, Michele CeriottiChemical 2020 · DOI

TL;DR

This paper introduces a novel "multi-scale equivariant representation" for machine learning models that predict atomic-scale properties. By combining local and non-local atomic information, this approach overcomes the limitations of traditional methods that struggle with long-range interactions like electrostatics and polarization, demonstrating improved accuracy across diverse chemical systems.

What Problem Does This Paper Address?

Machine learning (ML) models have become incredibly powerful for predicting properties of materials and molecules, largely by representing atomic environments using local descriptors. This "nearsightedness" principle, where an atom's properties are mainly influenced by its immediate neighbors, works well for many phenomena. However, this locality breaks down when dealing with long-range interactions, such as electrostatic forces between charged particles, collective polarization effects in materials, or van der Waals dispersion forces. These long-range effects are crucial for accurately describing systems like electrolytes, molecular crystals, and the response of materials to external fields. Existing ML approaches often struggle to capture these phenomena, leading to significant errors.

Methods

The core innovation is a "multi-scale equivariant representation" that fuses local and non-local information. It builds upon existing atom-centered density representations by incorporating a "potential field" derived from these densities. This combination is then symmetrized to ensure it transforms correctly under rotations and inversions (equivariance), a crucial property for physical descriptors. The authors show that the simplest form of this representation, termed LODE(1,1), can be formally linked to a multipole expansion of electrostatic interactions. This data-driven approach, however, allows it to capture a broader range of delocalized and collective effects beyond just permanent electrostatics. The representation is implemented using a basis set expansion and can be used within linear regression models, which facilitates interpretation and analysis of the learned physics.

Datasets

The paper utilizes several existing datasets and benchmarks for evaluation:

  • Organic dimers: A dataset of 2291 pairs of organic molecules from the BioFragment Database (BFDb) was used to test the model's ability to capture various intermolecular interactions (charged-charged, charged-polar, polar-polar, etc.). Binding curves were generated and DFT/PBE0 calculations were performed.
  • Lithium slab and water molecule: A custom dataset was generated by simulating the interaction between a slab of bec lithium and a water molecule at various distances and orientations. DFT/PBE calculations were used.
  • Polypeptides: A large dataset of 27428 conformers of single amino acids and 370 dipeptides was used to predict polarizability. Reference calculations were performed using Gaussian16 with the PWPB95-D3 functional.

Key Insights and Ideas

  • Bridging the local-nonlocal gap: The most significant insight is the successful integration of local and non-local information into a single, unified representation. This directly addresses a fundamental limitation of prior ML models.
  • Formal connection to multipole expansion: The simplest version of the multi-scale representation (LODE(1,1)) has a clear mathematical correspondence with the multipole expansion of electrostatic interactions. This provides a strong physical interpretation for its ability to capture long-range forces.
  • Data-driven flexibility: While inspired by physics, the data-driven nature of the representation allows it to learn and model complex, non-electrostatic long-range effects (like dispersion and induced polarization) without explicit physical parameterization.
  • Interpretability through linear models: The use of linear regression with these features allows for a direct interpretation of how different components of the representation contribute to predicting physical properties, revealing underlying physics.

Key Results

  • Organic dimers: The multi-scale LODE(1,1) model significantly outperformed traditional local descriptors (SOAP) in predicting binding energies for various classes of organic dimers, achieving accuracy limited only by the number of training points. It accurately captured interactions ranging from eV (charged dimers) to meV (apolar dimers).
  • Water-metal surface interaction: The model demonstrated a remarkable ability to capture the induced polarization of a metal surface by a water molecule, halving the prediction error compared to local models. This is a key demonstration of its capability beyond permanent electrostatics.
  • Polypeptide polarizability: For predicting the polarizability of polypeptides, the multi-scale model reduced prediction errors by 50% compared to purely local models, especially for larger molecules where long-range correlations are crucial.

Limitations and Future Work

  • Training set size: The performance of the model, particularly for underrepresented interaction classes (e.g., polar-polar dimers), was found to be limited by the size and diversity of the training set, rather than the inherent limitations of the representation itself.
  • Extrapolation: While the model shows good performance, the paper notes that the accuracy of extrapolation to unseen configurations or lengths can still be a challenge, especially for very large systems.
  • Future work: The authors suggest exploring different functional forms for the potential operator to explicitly incorporate dispersion-like interactions (e.g., 1/r^6). They also highlight the potential for combining this multi-scale approach with other ML techniques, such as multi-kernel models, to further optimize the balance between local and long-range descriptions. The flexibility of the framework also opens doors for modeling a wider range of phenomena beyond electrostatics.

Summary updated

Abstract

Electronic nearsightedness is one of the fundamental principles that governs the behavior of condensed matter and supports its description in terms of local entities such as chemical bonds. Locality also underlies the tremendous success of machine-learning schemes that predict quantum mechanical observables - such as the cohesive energy, the electron density, or a variety of response properties - as a sum of atom-centred contributions, based on a short-range representation of atomic environments. One of the main shortcomings of these approaches is their inability to capture physical effects ranging from electrostatic interactions to quantum delocalization, which have a long-range nature. Here we show how to build a multi-scale scheme that combines in the same framework local and non-local information, overcoming such limitations. We show that the simplest version of such features can be put in formal correspondence with a multipole expansion of permanent electrostatics. The data-driven nature of the model construction, however, makes this simple form suitable to tackle also different types of delocalized and collective effects. We present several examples that range from molecular physics to surface science and biophysics, demonstrating the ability of this multi-scale approach to model interactions driven by electrostatics, polarization and dispersion, as well as the cooperative behavior of dielectric response functions.
BibTeX
@inproceedings{grisafi2020multi,
  author = {Andrea Grisafi and Jigyasa Nigam and Michele Ceriotti},
  title = {{Multi-scale approach for the prediction of atomic scale properties}},
  booktitle = {Chemical},
  year = {2020},
  doi = {10.1039/d0sc04934d},
}
Figure