Prox-PINNs: A Deep Learning Algorithmic Framework for Elliptic Variational Inequalities

Yu Gao, Yongcun Song, Zhiyu Tan, Hangrui Yue, Shangzhi ZengarXiv 2025 · DOI · arXiv

TL;DR

Prox-PINNs is a new deep learning framework designed to solve Elliptic Variational Inequalities (EVIs)—a notoriously difficult class of problems involving non-smoothness and inequality constraints. By cleverly combining proximal operators with Physics-Informed Neural Networks (PINNs), the authors transform these inequalities into solvable nonlinear equations, offering a mesh-free, scalable alternative to traditional simulation methods.

What Problem Does This Paper Address?

Many real-world physical systems are governed not by simple equations, but by inequalities. Think of a pressurized elastic membrane pushed against a solid obstacle, the flow of "thick" fluids like mud or toothpaste (Bingham flows), or the way metal deforms under stress (elasto-plasticity). These are modeled as Elliptic Variational Inequalities (EVIs).

The challenge is threefold:

  1. Non-smoothness: Solutions often have "sharp" transitions or regions where the physics suddenly changes (e.g., where a membrane touches an obstacle).
  2. Inequalities: Standard neural networks and differential equation solvers are built for equalities; handling "greater than or equal to" constraints usually requires complex, unstable penalty methods.
  3. The Mesh Curse: Traditional methods like the Finite Element Method (FEM) require a predefined grid (mesh). If the geometry is complex or high-dimensional, the computational cost explodes.

While deep learning has tried to tackle this before, previous attempts were often "one-trick ponies"—tailored to one specific type of obstacle problem but failing to provide a general framework for the whole family of EVIs.

Methods

The authors introduce Prox-PINNs, which bridges the gap between optimization theory and deep learning through three key innovations:

  • The Proximal Reformulation: Instead of trying to solve the inequality directly, they use a proximal operator (a tool from convex optimization) to rewrite the EVI as a fixed-point nonlinear equation: $u = \text{Prox}(u - \text{physics residuals})$. This turns a "hard" inequality into a "soft" but mathematically exact equality that a neural network can minimize.
  • Hard Boundary Constraints: Rather than treating boundary conditions (like $u=0$ at the edges) as a "suggestion" in the loss function, they use an auxiliary function $h(x)$ to bake the boundary conditions directly into the network architecture. This ensures the solution is physically valid at the boundaries from the very first iteration.
  • Unified Multi-Output Architecture: For complex problems (like friction or fluid flow), the system requires an auxiliary variable ($\lambda$). The authors designed a network where the solution $u$ and the variable $\lambda$ share hidden layers. This "parameter sharing" ensures the two variables remain mathematically consistent with each other while reducing training time.

Datasets

Because this is a fundamental math/physics paper, the "datasets" are actually benchmark physical problems with known analytical or high-fidelity numerical solutions:

  • 1D & 2D Obstacle Problems: Testing how well the model finds the equilibrium of a membrane over a shape.
  • Elasto-Plastic Torsion: Modeling the stress distribution in a cylindrical bar.
  • Bingham Visco-Plastic Flows: Simulating fluid in a pipe that only moves once a certain pressure threshold is reached.
  • Simplified Friction Problems: Modeling contact mechanics between two bodies.

Key Insights and Ideas

  • Generality is Key: The framework is "plug-and-play." If you can define the proximal operator for your specific constraint (which is well-documented for most physical constraints), you can use this framework.
  • Stability over Brute Force: The authors discovered that some direct reformulations of these equations are numerically unstable (e.g., dividing by zero). They derived a specific "Case 4" loss function that bypasses these instabilities, significantly improving the reliability of the solver.
  • The "Forward Pass" Advantage: Unlike traditional FEM, which must re-solve the entire system from scratch if you want a higher-resolution result, a trained Prox-PINN can provide the solution at any point in space instantly via a single forward pass.

Key Results

  • High Precision: Across all tests, Prox-PINNs achieved relative $L^2$ errors between $10^{-3}$ and $10^{-5}$.
  • Outperforming Existing DL: In 1D obstacle benchmarks, Prox-PINNs maintained high accuracy even with very few training points, whereas previous deep learning methods saw errors jump to 47% under the same conditions.
  • Competitive with FEM: In friction problems, the method was comparable to the Virtual Finite Element Method (VEM) but offered the distinct advantage of being mesh-free and easier to implement for complex domains.
  • Robustness: The model proved insensitive to the choice of the hyperparameter $\eta$, meaning it doesn't require "babysitting" or extensive tuning to work on new problems.

Limitations and Future Work

While the results are promising, the authors note a few areas for growth:

  • Theoretical Foundations: The paper provides strong empirical evidence, but rigorous mathematical proofs for the convergence and stability of this specific neural architecture are still needed.
  • Adaptive Sampling: The current version uses random points for training. Integrating "adaptive sampling"—where the model focuses on areas with high residuals (like the edges of an obstacle)—could make training even faster.
  • Time-Dependency: This paper focuses on elliptic (steady-state) problems. The next logical step is extending Prox-PINNs to parabolic problems, which would allow for simulating how these systems evolve over time.

Summary updated

Abstract

Elliptic variational inequalities (EVIs) present significant challenges in numerical computation due to their inherent non-smoothness, nonlinearity, and inequality formulations. Traditional mesh-based methods often struggle with complex geometries and high computational costs, while existing deep learning approaches lack generality for diverse EVIs. To alleviate these issues, this paper introduces Prox-PINNs, a novel deep learning algorithmic framework that integrates proximal operators with physics-informed neural networks (PINNs) to solve a broad class of EVIs. The Prox-PINNs reformulate EVIs as nonlinear equations using proximal operators and then approximate the solutions via neural networks that enforce boundary conditions as hard constraints. Then the neural networks are trained by minimizing physics-informed residuals. The Prox-PINNs framework advances the state-of-the-art by unifying the treatment of diverse EVIs within a mesh-free and scalable computational architecture. The framework is demonstrated on several prototypical applications, including obstacle problems, elasto-plastic torsion, Bingham visco-plastic flows, and simplified friction problems. Numerical experiments validate the method's accuracy, efficiency, robustness, and flexibility across benchmark examples.
BibTeX
@misc{gao2025prox,
  author = {Yu Gao and Yongcun Song and Zhiyu Tan and Hangrui Yue and Shangzhi Zeng},
  title = {{Prox-PINNs: A Deep Learning Algorithmic Framework for Elliptic Variational Inequalities}},
  year = {2025},
  eprint = {2505.14430},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2505.14430},
  howpublished = {arXiv},
}
Figure