Scalable Hybrid Deep Neural Networks/Polarizable Potentials Biomolecular Simulations including long-range effects

Théo Jaffrelot Inizan, Thomas Plé, Olivier Adjoua, Pengyu Ren, Hattice Gökcan, Olexandr Isayev, Louis Lagardère, Jean‐Philip Piquemal

This paper introduces Deep-HP, a high-performance software platform that integrates deep learning potentials with polarizable force fields to enable large-scale, high-accuracy biomolecular simulations. By combining the ANI-2X neural network with the AMOEBA polarizable force field, the authors achieve "chemical accuracy" in predicting binding energies for complex systems while maintaining the scalability needed to simulate millions of atoms on multi-GPU clusters.

TL;DR

Deep-HP bridges the gap between the speed of classical physics-based simulations and the accuracy of quantum-derived neural networks. It enables nanosecond-scale simulations of 100k-atom systems, providing a powerful new tool for drug discovery and biophysics.

What Problem Does This Paper Address?

Molecular Dynamics (MD) simulations are essential for understanding how drugs bind to proteins, but they face a persistent "accuracy vs. speed" trade-off.

  1. Classical Force Fields (FFs): These are fast but often fail to capture complex electronic effects like polarization or many-body interactions.
  2. Machine Learning Potentials (MLPs): Models like ANI-2X offer near-quantum accuracy for small molecules but struggle with long-range electrostatics and don't scale well to massive biological systems (100k+ atoms).
  3. The Hybrid Gap: Previous attempts to combine these (QM/MM) were often too slow for routine use or suffered from artifacts at the interface between the "accurate" and "fast" regions.

The authors tackle these issues by creating a scalable framework that allows MLPs to handle the "interesting" part of the system (the drug/solute) while a sophisticated polarizable force field handles the rest (the solvent and long-range physics).

Methods

The researchers developed Deep-HP as an extension of the Tinker-HP package. Key technical innovations include:

  • Zero-Copy GPU Interface: Using the C Foreign Function Interface (cffi) and PyCUDA, they pass memory addresses of data directly between the C-based MD engine and Python-based ML frameworks (PyTorch/TensorFlow). This avoids the massive performance hit of moving data between the CPU and GPU.
  • ANI-2X/AMOEBA Hybrid Potential: They partition the system's energy. Solute-solute interactions are calculated by the ANI-2X neural network, while solvent-solvent and solvent-solute interactions use the AMOEBA polarizable force field.
  • Long-Range Physics: Unlike many ML potentials that ignore long-range effects, this hybrid model uses Particle Mesh Ewald (PME) to explicitly include AMOEBA’s physical long-range interactions.
  • MTS Acceleration: They implemented a Multiple-Timestep (MTS) strategy (RESPA). The expensive neural network forces are calculated less frequently as "corrections" to the faster AMOEBA forces, resulting in a 10x speedup over standard integration methods.

Datasets

The study utilizes several benchmarks to validate the platform:

  • Scaling Benchmarks: Water boxes ranging from 648 to 7.7 million atoms to test multi-GPU performance.
  • Solvated Proteins: Standard systems like DHFR (23k atoms) and SARS-CoV2 $M^{pro}$ (98k atoms).
  • Solvation Free Energies: A dataset of 71 small molecules across four solvents (Water, Toluene, Acetonitrile, DMSO).
  • SAMPL Challenges: 14 challenging host-guest complexes from the SAMPL4 and SAMPL6 blind challenges used to test absolute binding free energies.

Key Insights and Ideas

  • The "Best of Both Worlds" Partition: The authors show that you don't need the neural network to simulate the entire system. By letting the DNN handle the complex, short-range chemistry of the ligand and letting AMOEBA handle the bulk solvent, they achieve high accuracy at a fraction of the cost.
  • Polarization is the Bridge: Using a polarizable force field (AMOEBA) as the background is crucial. It allows the solvent to adapt its electronic state to the "quantum-like" charge distribution of the DNN-managed solute, reducing interface artifacts.
  • Scalability is Solved: Deep-HP demonstrates linear scaling up to 124 GPUs, proving that deep learning potentials are finally ready for "production-scale" biophysics.

Key Results

  • Speed: Reached production speeds of several nanoseconds per day for 100k-atom systems.
  • Accuracy: In solvation free energy tests, the hybrid model achieved an RMSE of ~0.7–0.9 kcal/mol, consistently outperforming pure AMOEBA in non-aqueous solvents.
  • Binding Affinity: On the SAMPL host-guest challenge, the ANI-2X/AMOEBA model reached an RMSE of 0.94 kcal/mol, significantly better than the 1.81 kcal/mol achieved by pure AMOEBA. This brings the simulation within the coveted "chemical accuracy" range (< 1 kcal/mol).

Limitations and Future Work

  • Reactivity Constraints: While ANI-2X is a reactive potential (it can model bond breaking), the current hybrid setup assumes a non-reactive environment for the solvent. In one case (the C3 ligand), a proton transfer event occurred that the hybrid integrator struggled to handle stably.
  • Amine Outliers: The authors noted specific errors with amine groups, suggesting that the underlying ANI-2X training data or the hybrid coupling for these specific functional groups needs refinement.
  • Future Directions: The team plans to explore "adaptive" timestepping and more advanced neural network architectures to further improve the handling of reactive events and complex protein-ligand interfaces.

Summary updated

Abstract

Deep-HP is a scalable extension of the \TinkerHP\ multi-GPUs molecular dynamics (MD) package enabling the use of Pytorch/TensorFlow Deep Neural Networks (DNNs) models. Deep-HP increases DNNs MD capabilities by orders of magnitude offering access to ns simulations for 100k-atom biosystems while offering the possibility of coupling DNNs to any classical (FFs) and many-body polarizable (PFFs) force fields. It allows therefore to introduce the ANI-2X/AMOEBA hybrid polarizable potential designed for ligand binding studies where solvent-solvent and solvent-solute interactions are computed with the AMOEBA PFF while solute-solute ones are computed by the ANI-2x DNN. ANI-2X/AMOEBA explicitly includes AMOEBA's physical long-range interactions via an efficient Particle Mesh Ewald implementation while preserving ANI-2X's solute short-range quantum mechanical accuracy. The DNNs/PFFs partition can be user-defined allowing for hybrid simulations to include biosimulation key ingredients such as polarizable solvents, polarizable counter ions, etc... ANI-2X/AMOEBA is accelerated using a multiple-timestep strategy focusing on the models contributions to low-frequency modes of nuclear forces. It primarily evaluates AMOEBA forces while including ANI-2x ones only via correction-steps resulting in an order of magnitude acceleration over standard Velocity Verlet integration. Simulating more than 10 $μ$, we compute charged/uncharged ligands solvation free energies in 4 solvents, and absolute binding free energies of host-guest complexes from SAMPL challenges. ANI-2X/AMOEBA average errors are within chemical accuracy opening the path towards large-scale hybrid DNNs simulations, at force-field cost, in biophysics and drug discovery.
BibTeX
@inproceedings{inizan2023scalable,
  author = {Théo Jaffrelot Inizan and Thomas Plé and Olivier Adjoua and Pengyu Ren and Hattice Gökcan and Olexandr Isayev and Louis Lagardère and Jean‐Philip Piquemal},
  title = {{Scalable Hybrid Deep Neural Networks/Polarizable Potentials Biomolecular Simulations including long-range effects}},
  booktitle = {Chemical},
  year = {2023},
  doi = {10.1039/d2sc04815a},
}
Figure