JAX-SPH: A Differentiable Smoothed Particle Hydrodynamics Framework

Artur P. Toshev, Harish Ramachandran, Jonas A. Erbesdobler, Gianluca Galletti, Johannes Brandstetter, Nikolaus A. Adams

TL;DR

This paper introduces JAX-SPH, a novel framework for Smoothed Particle Hydrodynamics (SPH) simulations built with JAX. This framework is designed for seamless integration with deep learning, enabling differentiable fluid simulations for tasks like inverse design and hybrid solver approaches.

What Problem Does This Paper Address?

Simulating fluid dynamics, especially with complex phenomena like free surfaces, is computationally intensive. While machine learning (ML) is increasingly used to accelerate these simulations, most existing ML-friendly fluid solvers are Eulerian (grid-based). Lagrangian methods, like SPH, which track individual fluid particles, are more natural for certain problems but have historically been harder to integrate with deep learning frameworks due to their dynamic particle connectivity. This paper addresses the need for a differentiable, ML-compatible Lagrangian fluid solver.

Methods

The core contribution is JAX-SPH, a Smoothed Particle Hydrodynamics (SPH) framework implemented in JAX. JAX's automatic differentiation capabilities are central to making the SPH solver differentiable. The framework builds upon existing code for dataset generation and extends it by:

  • Integrating advanced SPH algorithms: This includes Transport Velocity (to mitigate tensile instabilities), Riemann SPH (for reduced numerical dissipation), and thermal diffusion.
  • Generalized Wall Boundary Conditions: The implementation supports both no-slip and free-slip conditions for walls, crucial for realistic simulations.
  • Python Package Structure: The code is refactored into a user-friendly Python package.
  • Gradient Validation: The paper rigorously verifies the accuracy of the automatically computed gradients against finite difference methods.
  • Solver-in-the-Loop (SitL): They adapt the SitL paradigm, which interleaves a coarse solver with a learned corrector, for temporal coarsening in SPH. This allows for faster simulations by learning to correct the errors of a simplified SPH solver.

Datasets

The paper leverages the LagrangeBench project for dataset generation. Specific datasets used for experiments include:

  • Taylor-Green Vortex (TGV): Used for gradient validation and 3D simulations.
  • Lid-Driven Cavity (LDC): Used for solver validation.
  • Dam Break: Used for validation of the Riemann SPH solver.
  • Reverse Poiseuille Flow (RPF) 2D dataset: Used for training and evaluating the Solver-in-the-Loop approach. This dataset consists of positions sampled at coarser time intervals than the ground truth.

Key Insights and Ideas

  • Differentiable Lagrangian Solvers are Crucial: The paper highlights that for certain fluid dynamics problems, Lagrangian approaches are more suitable, and making them differentiable unlocks powerful ML applications.
  • JAX is a Strong Candidate for Differentiable Physics: The choice of JAX is justified by its performance on graph-based operations and its seamless integration with ML libraries.
  • SPH's Natural Fit with Graph Neural Networks: The paper draws an analogy between SPH's kernel-based particle interactions and Graph Neural Networks (GNNs), suggesting a natural synergy for ML integration.
  • Solver-in-the-Loop for Temporal Coarsening: Adapting SitL for temporal coarsening in SPH is a novel application, demonstrating how to accelerate simulations by learning corrections to a simplified solver.
  • Gradient-Based Optimization for Inverse Problems: The successful application to an inverse problem (finding initial conditions from final state) showcases the practical utility of differentiable SPH.

Key Results

  • Gradient Accuracy: The paper demonstrates that JAX-SPH's automatically computed gradients are accurate, matching finite difference approximations over multiple solver steps.
  • Inverse Problem Solved: JAX-SPH successfully solves an inverse problem of finding initial particle positions given a final state of a falling water cube, achieving good results within 15 gradient descent steps.
  • Solver-in-the-Loop Performance: The SitL implementation shows promising results, outperforming a solver-only approach and achieving competitive metrics compared to a purely learned GNS model on the RPF dataset. For instance, the SitL model achieved an MSE20 of 1.3e-7, significantly better than the solver-only MSE20 of 7.9e-6.
  • Validation of SPH Variants: The paper provides extensive validation for standard SPH, transport velocity SPH, and Riemann SPH across various benchmark cases (TGV, LDC, Dam Break) in 2D and 3D, showing good agreement with theoretical results and existing solvers.

Limitations and Future Work

  • Custom Adjoints: The authors acknowledge that they exclusively use JAX's grad function and leave the implementation of more advanced custom adjoints (e.g., for better performance on complex simulations) to future work.
  • Parallel HPC: The current focus is on ML integration rather than developing a highly parallel HPC code.
  • More SPH Algorithms and Cases: The authors express a desire to add more SPH algorithms and simulation scenarios in the future.
  • Foundation Models for PDEs: A particularly exciting future direction is the development of foundation models for PDEs that can handle both Eulerian and Lagrangian data, potentially incorporating encoded symmetries.

Summary updated

Abstract

Particle-based fluid simulations have emerged as a powerful tool for solving the Navier-Stokes equations, especially in cases that include intricate physics and free surfaces. The recent addition of machine learning methods to the toolbox for solving such problems is pushing the boundary of the quality vs. speed tradeoff of such numerical simulations. In this work, we lead the way to Lagrangian fluid simulators compatible with deep learning frameworks, and propose JAX-SPH - a Smoothed Particle Hydrodynamics (SPH) framework implemented in JAX. JAX-SPH builds on the code for dataset generation from the LagrangeBench project (Toshev et al., 2023) and extends this code in multiple ways: (a) integration of further key SPH algorithms, (b) restructuring the code toward a Python package, (c) verification of the gradients through the solver, and (d) demonstration of the utility of the gradients for solving inverse problems as well as a Solver-in-the-Loop application. Our code is available at https://github.com/tumaer/jax-sph.
BibTeX
@inproceedings{toshev2024jax,
  author = {Artur P. Toshev and Harish Ramachandran and Jonas A. Erbesdobler and Gianluca Galletti and Johannes Brandstetter and Nikolaus A. Adams},
  title = {{JAX-SPH: A Differentiable Smoothed Particle Hydrodynamics Framework}},
  booktitle = {AI4DiffEqtnsInSci @ ICLR},
  year = {2024},
  url = {https://openreview.net/forum?id=8X5PXVmsHW},
}
Figure