Broadening the Scope of Neural Network Potentials through Direct Inclusion of Additional Molecular Attributes

Guillem Simeon, Antonio Mirarchi, Raul P. Pelaez, Raimondas Galvelis, Gianni De Fabritiis

TL;DR

Standard neural network potentials are often "blind" to a molecule's electronic state, treating different charges or spin states of the same geometry as identical. This paper introduces a simple, "zero-cost" architectural modification to TensorNet that incorporates these attributes, effectively resolving input degeneracy and achieving state-of-the-art accuracy across diverse chemical systems without requiring complex physics-based energy terms.

What Problem Does This Paper Address?

Most modern neural network potentials (NNPs) rely solely on two inputs: atomic numbers ($Z$) and atomic positions ($r$). While powerful, this creates a fundamental flaw known as input degeneracy.

Imagine a molecule that can exist as a neutral species, a cation, or an anion. If the atoms are in the same positions, a standard NNP will predict the exact same energy and forces for all three states, even though their physical properties are vastly different. To avoid this, researchers often have to curate datasets to exclude charged species or implement complex, computationally expensive "physics-informed" modules (like charge equilibration or Ewald summations) to handle long-range electrostatics. The authors sought a simpler way to make models "aware" of electronic states like total charge and spin.

Methods

The authors build upon TensorNet, a state-of-the-art equivariant model that represents atomic environments using rank-2 tensors (3x3 matrices).

Their innovation is a remarkably simple node-wise modification. They introduce a state-dependent scalar factor to the interaction and update layers of the network. Specifically, they modify the tensor features $Y$ and updates $\Delta X$ using the formula: $$ (1 + \lambda_k \psi_k) $$ Where $\psi_k$ represents a molecular attribute (like total charge $Q$ or spin $S$) and $\lambda_k$ is a weighting factor.

Why this works: * Equivariance: Because the modification is a scalar rescaling, it doesn't break the model's rotation and reflection symmetry (O(3) equivariance). * Zero-Cost: It requires no major architectural changes or additional expensive descriptors. * Defaults to Baseline: When the system is neutral ($Q=0$) and in a singlet state ($S=0$), the model mathematically reduces to the original TensorNet.

Datasets

The researchers validated their approach across a wide range of benchmarks:

  • Toy Degeneracy Datasets (A & B): Custom-made pairs of molecules with identical geometries but different total charges (e.g., $O_2$ vs $O_2^{2-}$).
  • SPICE PubChem: A large dataset of drug-like molecules. While only 4% of the data is charged, it serves as a test for real-world imbalance.
  • Cluster Benchmarks: Specific challenging systems including carbon chains ($C_{10}H_2/C_{10}H_3^+$), silver clusters ($Ag_3^{+/-}$), and sodium chloride clusters ($Na_{8/9}Cl_8^+$).
  • Solvated Protein Fragments: A massive dataset (>2.7M structures) featuring various protonation states.
  • QMspin: A dataset of ~13,000 carbene structures in both singlet and triplet states to test spin-state awareness.

Key Insights and Ideas

  • Resolving Blind Spots: The most striking "aha moment" occurs with the $Ag_3^{+/-}$ silver clusters. The baseline model, unable to distinguish the cation from the anion, produces massive errors. The modified model resolves this instantly.
  • Better Representations for Everyone: Interestingly, including charge information improved accuracy even for neutral molecules in the SPICE dataset. This suggests that "charge awareness" helps the model develop more physically meaningful internal representations of chemical environments in general.
  • Implicit vs. Explicit Physics: Unlike models like SpookyNet, which use explicit terms for Coulomb interactions and nuclear repulsion, this modified TensorNet learns these effects implicitly through its message-passing layers.
  • Efficiency: The model maintains $O(N)$ scaling. In speed benchmarks, it outperformed SpookyNet (which scales at $O(N^2)$ for electrostatics), clocking in at 1.46 ms per inference step vs. 1.75 ms.

Key Results

The quantitative improvements are significant across the board:

  • Degeneracy Breaking: On the $Ag_3^{+/-}$ cluster, energy error dropped from a staggering 1683.11 meV/atom to just 0.888 meV/atom (see Table 3).
  • Spin States: On the QMspin dataset, the inclusion of spin state $S$ improved accuracy 10-fold, reaching "chemical accuracy" (43 meV) and outperforming SpookyNet by ~40%.
  • Protein Fragments: The model nearly halved the energy error of the previous best ensemble (PhysNet-ens5), dropping from 0.95 kcal/mol to 0.55 kcal/mol.
Molecules used in the toy datasets to demonstrate input degeneracy.
Figure 1: The columns show pairs that look identical to a standard NNP but have different charges.
Table 3: Performance on challenging charged benchmarks. Note the massive error reduction for Ag3 clusters.

Limitations and Future Work

While highly effective, the authors note a few areas for growth:

  • Asymptotic Behavior: Because the model learns charge effects implicitly, it does not strictly guarantee the $1/r$ long-range behavior required by physical laws for very distant interactions.
  • Simultaneous Attributes: The current work mostly tests attributes (charge vs. spin) separately. Combining multiple attributes requires careful weighting to avoid new types of mathematical degeneracies.
  • Learnable Weights: Future iterations could make the $\lambda$ weights learnable functions of the local atomic environment rather than fixed per-layer constants.

Summary updated

Abstract

Most state-of-the-art neural network potentials do not account for molecular attributes other than atomic numbers and positions, which limits its range of applicability by design. In this work, we demonstrate the importance of including additional electronic attributes in neural network potential representations with a minimal architectural change to TensorNet, a state-of-the-art equivariant model based on Cartesian rank-2 tensor representations. By performing experiments on both custom-made and public benchmarking datasets, we show that this modification resolves the input degeneracy issues stemming from the use of atomic numbers and positions alone, while enhancing the model's predictive accuracy across diverse chemical systems with different charge or spin states. This is accomplished without tailored strategies or the inclusion of physics-based energy terms, while maintaining efficiency and accuracy. These findings should furthermore encourage researchers to train and use models incorporating these additional representations.
BibTeX
@article{simeon2025broadening,
  author = {Guillem Simeon and Antonio Mirarchi and Raul P. Pelaez and Raimondas Galvelis and Gianni De Fabritiis},
  title = {{Broadening the Scope of Neural Network Potentials through Direct Inclusion of Additional Molecular Attributes}},
  journal = {Journal of Chemical Theory and Computation},
  year = {2025},
  doi = {10.1021/acs.jctc.4c01625},
}
Figure