Energy Dissipation Rate Guided Adaptive Sampling for Physics-Informed Neural Networks: Resolving Surface-Bulk Dynamics in Allen-Cahn Systems

Chunyan Li, Wenkai Yu, Qi Wang

TL;DR

The authors introduce EDRAS (Energy Dissipation Rate guided Adaptive Sampling), a physics-informed strategy that improves how Physics-Informed Neural Networks (PINNs) learn complex thermodynamic systems. By using the physical energy dissipation rate—rather than just mathematical residuals—to choose training points, EDRAS achieves up to a sixfold reduction in error and handles complex geometries and dynamic boundary conditions far more effectively than traditional methods.

What Problem Does This Paper Address?

Physics-Informed Neural Networks (PINNs) have revolutionized scientific computing by embedding physical laws directly into the loss functions of neural networks. However, they often stumble when facing "stiff" problems or systems with multiscale dynamics, such as the Allen-Cahn equation (used to model phase separation).

The core issue lies in sampling. Standard PINNs often use uniform sampling, which misses the sharp interfaces where the "action" happens. Existing adaptive methods, like Residual-based Adaptive Refinement (RAR), pick new training points where the PDE residual is high. The authors identify a "Residual Trap": in many systems, the residual can be small even when the actual approximation error is large. Consequently, RAR ignores these critical regions, leading to poor convergence and inaccuracy in complex geometries.

Methods

The researchers propose EDRAS, which shifts the focus from mathematical residuals to physical energy.

  1. Energy Dissipation as a Metric: In thermodynamically consistent systems, the solution moves toward a local energy minimum. The local energy dissipation rate density ($e_{edrd}$) acts as a natural indicator of where the system is changing most rapidly.
  2. Adaptive Re-sampling: Instead of just looking for high residuals, EDRAS identifies regions with high energy dissipation. It dynamically adds collocation points to these "high-activity" areas in both the interior (bulk) and the boundary (surface) of the domain.
  3. Density-Aware Pruning: To keep the model computationally efficient, the algorithm prunes points with very low dissipation while maintaining a minimum point density to ensure the entire domain remains "covered."
  4. Lower Computational Overhead: Calculating energy dissipation typically involves lower-order derivatives than calculating the full PDE residual, making EDRAS faster per iteration than many residual-based competitors.

Datasets

The paper evaluates the method using synthetic benchmarks where "ground truth" is established via high-resolution Finite Difference Methods (FDM):

  • 1D Allen-Cahn: A standard benchmark with periodic boundary conditions.
  • 2D Complex Geometries: The model is tested on disk-shaped and ellipse-shaped domains.
  • Dynamic Boundary Conditions: Unlike standard "static" boundaries, these benchmarks include scenarios where the boundary itself has its own thermodynamic evolution, creating complex surface-bulk coupling.

Key Insights and Ideas

  • The "Group A" Breakthrough: The authors categorize training points into four groups based on the relationship between residual and error. They prove that traditional RAR almost entirely misses "Group A" (low residual, high error). EDRAS, by following the energy landscape, successfully identifies and samples these "hidden" high-error points.
  • Physics-Guided vs. Math-Guided: While residuals tell you how well the network satisfies the equation, energy dissipation tells you where the physics is most "active." Aligning the training points with the underlying physical structure proves to be a much more robust strategy.
  • Surface-Bulk Synergy: The paper provides a rare look at how dynamic boundary conditions influence the interior of a system. EDRAS is particularly adept at capturing the "influence zone" near boundaries, which is often where PINNs fail in irregular shapes like ellipses.

Key Results

  • Superior Accuracy: In 1D tests, EDRAS achieved a sixfold reduction in relative Mean Square Error (MSE) compared to the standard RAR method.
  • Efficiency: EDRAS was shown to be more likely to identify high-impact collocation points than Residual-based Adaptive Distribution (RAD) methods, while requiring less memory and computational power to estimate global distributions.
  • Robustness in 2D: The method successfully resolved complex phase-field dynamics in non-rectangular domains (disks and ellipses), maintaining high accuracy even as the "mobility" (speed of the system) increased.
  • Qualitative Success: Contour plots show that EDRAS-enhanced PINNs perfectly capture the sharp interfaces of phase separation, whereas RAR-enhanced models often show "blurring" or artifacts in low-residual/high-error zones.

Limitations and Future Work

  • Thermodynamic Requirement: The primary limitation is that EDRAS requires the system to be "thermodynamically consistent"—meaning you must be able to define a free energy functional for the system. It cannot be applied to arbitrary PDEs that lack an energy structure.
  • Hyperparameter Tuning: The performance is sensitive to the initial density threshold ($d_f^{(0)}$). The authors noted a "saturation and rebound" effect where increasing the density too much can actually degrade performance, requiring careful balance.
  • Future Directions: The authors suggest extending EDRAS to more complex coupled systems, such as the Cahn-Hilliard equation or fluid dynamics models (Navier-Stokes-Cahn-Hilliard), where energy dissipation is even more central to the dynamics.

Summary updated

Abstract

We introduce the Energy Dissipation Rate guided Adaptive Sampling (EDRAS) strategy, a novel method that substantially enhances the performance of Physics-Informed Neural Networks (PINNs) in solving thermodynamically consistent partial differential equations (PDEs) over arbitrary domains. EDRAS leverages the local energy dissipation rate density as a guiding metric to identify and adaptively re-sample critical collocation points from both the interior and boundary of the computational domain. This dynamical sampling approach improves the accuracy of residual-based PINNs by aligning the training process with the underlying physical structure of the system. In this study, we demonstrate the effectiveness of EDRAS using the Allen-Cahn phase field model in irregular geometries, achieving up to a sixfold reduction in the relative mean square error compared to traditional residual-based adaptive refinement (RAR) methods. Moreover, we compare EDRAS with other residual-based adaptive sampling approaches and show that EDRAS is not only computationally more efficient but also more likely to identify high-impact collocation points. Through numerical solutions of the Allen-Cahn equation with both static (Neumann) and dynamic boundary conditions in 2D disk- and ellipse-shaped domains solved using PINN coupled with EDRAS, we gain significant insights into how dynamic boundary conditions influence bulk phase evolution and thermodynamic behavior. The proposed approach offers an effective, physically informed enhancement to PINN frameworks for solving thermodynamically consistent models, making PINN a robust and versatile computational tool for investigating complex thermodynamic processes in arbitrary geometries.
BibTeX
@misc{li2025energy,
  author = {Chunyan Li and Wenkai Yu and Qi Wang},
  title = {{Energy Dissipation Rate Guided Adaptive Sampling for Physics-Informed Neural Networks: Resolving Surface-Bulk Dynamics in Allen-Cahn Systems}},
  year = {2025},
  eprint = {2507.09757},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2507.09757},
}

Loading related content...

Figure