Gold-standard solutions to the Schrödinger equation using deep learning: How much physics do we need?

Leon Gerard, Michael Scherbela, Philipp Marquetand, Philipp Grohs

TL;DR

Researchers have developed a new deep learning architecture that solves the electronic Schrödinger equation with unprecedented accuracy and efficiency, achieving 40-70% lower energy errors at 6x lower computational cost than previous state-of-the-art methods. Crucially, the study reveals a counter-intuitive finding: forcing too much "textbook" physical prior knowledge into the model can actually backfire, suggesting that neural networks perform best when given the freedom to learn complex electron interactions with minimal bias.

What Problem Does This Paper Address?

Solving the Schrödinger equation is the "Holy Grail" of computational chemistry. In theory, it allows us to predict the properties of any molecule or material from first principles, which is vital for drug discovery and materials science. In practice, it is a nightmare to solve because of the "curse of dimensionality"—the complexity grows exponentially with the number of electrons.

To be useful for chemistry, we need extreme precision. As shown in Figure 1, while the total energy of a molecule like $N_2$ is huge, the energy differences that determine chemical reactions are tiny—requiring an accuracy of roughly 99.998%.

Figure 1: Conceptual visualization of the required accuracies on the example of an N2 molecule: For chemical applications, total energies must achieve accuracies of ∼99.998%.

Existing "gold-standard" classical methods like CCSD(T) are accurate but don't scale well to larger systems. Recent deep learning approaches, specifically Deep Learning Variational Monte Carlo (DL-VMC), have shown promise but still struggle to reach the desired accuracy efficiently.

Methods

The authors introduce an improved DL-VMC architecture that builds upon and refines two major predecessors: FermiNet and PauliNet. Their approach, implemented in the DeepErwin package, introduces several key innovations:

  1. SchNet-like Convolutions: They use a sophisticated embedding network (Figure 2) that employs continuous-filter convolutions to better model the complex two-particle interactions between electrons.
  2. Local Invariant Features: Instead of using raw coordinates, they propose using local coordinate systems centered on each nucleus (Figure 3). This makes the model invariant to rotations while remaining highly expressive and sensitive to the local chemical environment.
  3. Physics-Inspired Initialization: Rather than starting with random weights, they initialize the "orbital envelopes" (which describe how electron density decays far from a nucleus) using the atomic number $Z$. This provides a "soft" physical bias that accelerates convergence.
Figure 2: Our architecture: a) High-level overview b) One single embedding iteration c) Sub-block of assembling symmetric features
Figure 3: Visualization of resulting coordinate systems for 2 example molecules: a) Ethene b) A hypothetical bent chain of atoms.

Datasets

The "datasets" in this field are specific atoms and molecules used as benchmarks. The authors evaluated their method on a diverse set of systems:

  • Atoms: From small ones like Fluorine (F) and Neon (Ne) to larger 4th-row atoms like Potassium (K) and Iron (Fe).
  • Small Molecules: $N_2$ (at various bond lengths), Ethene ($C_2H_4$), Water ($H_2O$), Carbon Monoxide (CO), and Ammonia ($NH_3$).
  • Larger Molecules: Cyclobutadiene ($C_4H_4$), Benzene ($C_6H_6$), and the amino acid Glycine ($C_2H_5NO_2$).

They established new variational ground state energy benchmarks for many of these, outperforming both previous deep learning results and classical "gold-standard" methods.

Key Insights and Ideas

  • The "Less is More" Paradox: The most surprising finding is that including more physical prior knowledge (like using CASSCF, a sophisticated classical method, to define the model's shape) actually decreased accuracy. These rigid physical priors act as a "strong bias" that the neural network cannot easily overcome during training.
  • Expressiveness over Bias: The success of their model comes from being a "strict generalization" of previous models. By making the architecture more expressive (e.g., using dense determinants and SchNet-like layers), the network can find better solutions than those constrained by traditional physical approximations.
  • Soft Guidance Wins: While "hard" physical constraints failed, "soft" guidance—like better hyperparameter tuning and physics-inspired weight initialization—significantly boosted performance and convergence speed.

Key Results

The authors achieved a new state-of-the-art in variational ground state energies across nearly all tested systems.

  • Accuracy: They reduced energy errors by 40-70% compared to FermiNet. For large systems like Glycine and Iron, they outperformed classical "gold-standard" methods by approximately 100 mHa.
  • Efficiency: Their method reaches these higher accuracies 6x faster than previous approaches.
  • Benchmark Dominance: As seen in Figure 4 (below), their results (green and yellow bars) consistently reach lower, more accurate energy levels than the best previously published variational results (purple bars).
Figure 4: Energies relative to the previously known best estimate, (lower is better). Blue bars depict best published variational energies, footnotes mark the method: a: FermiNet VMC [10, 17], b: Conventional DMC [25, 26, 27], c: FermiNet DMC [21], d: MRCI-F12. A table of absolute energies and methods for Eref can be found in appendix A. Note that Eref is not necessary variational and thus may underestimate the true energy.

Limitations and Future Work

  • Computational Cost: Despite the 6x speedup, these calculations still require days of GPU time for larger molecules, which limits their use for high-throughput screening.
  • Heavy Atoms: For atoms with high nuclear charges (high $Z$), the wavefunction becomes very localized, making the Monte Carlo sampling process more difficult and requiring more intermediate steps.
  • Future Directions: The authors suggest that further research into Monte Carlo sampling methods and exploring the "regularity" of wavefunctions across different geometries could lead to even more efficient and generalizable models.

Summary updated

Abstract

Finding accurate solutions to the Schrödinger equation is the key unsolved challenge of computational chemistry. Given its importance for the development of new chemical compounds, decades of research have been dedicated to this problem, but due to the large dimensionality even the best available methods do not yet reach the desired accuracy. Recently the combination of deep learning with Monte Carlo methods has emerged as a promising way to obtain highly accurate energies and moderate scaling of computational cost. In this paper we significantly contribute towards this goal by introducing a novel deep-learning architecture that achieves 40-70% lower energy error at 6x lower computational cost compared to previous approaches. Using our method we establish a new benchmark by calculating the most accurate variational ground state energies ever published for a number of different atoms and molecules. We systematically break down and measure our improvements, focusing in particular on the effect of increasing physical prior knowledge. We surprisingly find that increasing the prior knowledge given to the architecture can actually decrease accuracy.
BibTeX
@inproceedings{gerard2022gold,
  author = {Leon Gerard and Michael Scherbela and Philipp Marquetand and Philipp Grohs},
  title = {{Gold-standard solutions to the Schrödinger equation using deep learning: How much physics do we need?}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2022},
  url = {https://openreview.net/forum?id=o5mEPybrmHe},
}
Figure