Variationally correct physics-informed operator learning for nonlinear partial differential equations

Yuan Qiu, Wolfgang Dahmen, Peng ChenarXiv 2026 · arXiv

Training neural operators to solve partial differential equations (PDEs) without labeled data is the "holy grail" of scientific machine learning. While Physics-Informed Neural Networks (PINNs) and their operator counterparts (PINOs) have shown great promise, they often suffer from a fundamental reliability issue: Does a small training residual actually mean a small solution error?

In this paper, Qiu, Dahmen, and Chen provide a rigorous mathematical foundation for answering "yes" for nonlinear PDEs. By extending the concept of "variational correctness" to nonlinear systems, they show how to build neural operators that are not just fast, but mathematically guaranteed to track the true physical error.

TL;DR

The authors prove that for nonlinear PDEs formulated as first-order systems, the least-squares residual is locally equivalent to the actual solution error in a "PDE-compliant" norm. By integrating finite element assembly directly into the neural network's training loop, they create a Reduced Basis Neural Operator (RBNO) that significantly outperforms standard grid-based physics-informed baselines in both accuracy and reliability.

What Problem Does This Paper Address?

Most physics-informed models train by minimizing a "pointwise" residual—essentially checking if the PDE holds at a bunch of discrete points. However, for many problems (especially those with jumping coefficients or complex interfaces), a small pointwise residual can be deceptive. It might vanish at a "wrong" solution that fails to satisfy essential transmission conditions.

Furthermore, error is often measured in simple $L^2$ norms, which might not capture the derivatives or fluxes that engineers actually care about. The authors argue for variational correctness: a training loss that is mathematically equivalent to the error in the natural norm dictated by the physics (the "PDE-compliant" norm).

Methods

The authors employ several key strategies to bridge the gap between deep learning and classical numerical analysis:

  1. First-Order System Least Squares (FOSLS): Instead of solving a second-order PDE for a single variable $u$, they rewrite the physics as a system of first-order equations involving both $u$ and its flux/stress $\sigma$. This ensures that quantities like mass or momentum conservation are baked into the state space.
  2. Mathematical Proof of Equivalence: They prove that if the linearized version of the PDE is stable and its derivative is Lipschitz continuous, the FOSLS residual provides a "two-sided" bound on the error. This means the residual can't be small if the error is large, and vice versa.
  3. Reduced Basis Neural Operator (RBNO): The network doesn't predict the solution everywhere. Instead, it predicts the coefficients for a Reduced Basis—a set of highly efficient "shape functions" learned from a few initial snapshots via Proper Orthogonal Decomposition (POD).
  4. Differentiable Finite Element Training: Unlike standard PINOs that evaluate residuals on a grid, this method uses a finite element library (like DOLFINx) inside the training loop. The loss and its gradient are assembled using proper quadrature, ensuring the network learns in a "conforming" function space.

For a detailed breakdown of the mathematical symbols and spaces used in this framework, see the notation summary:

Table 1: Notation and mathematical spaces used in the FOSLS framework.

Datasets

The authors evaluated their approach on three distinct nonlinear benchmarks, each presenting a different mathematical challenge:

  • Semilinear Diffusion-Reaction: Heat conduction with a cubic reaction term ($\kappa u^3$), featuring sixteen disjoint inclusions with high-contrast conductivities.
  • Quasilinear Diffusion: A flow problem where permeability depends on the solution itself ($1 + u^2$), driven by multiple Gaussian source "wells."
  • Compressible Hyperelasticity: A Neo-Hookean body under traction, representing large-deformation mechanics where the stress law is non-polynomial and only defined for valid (orientation-preserving) shapes.

Key Insights and Ideas

  • Pointwise Residuals Can Lie: The authors demonstrate that for problems with jumping coefficients, standard pointwise residuals can vanish at solutions that violate physical interface conditions. The FOSLS approach avoids this by enforcing flux continuity in the $H(\text{div})$ space.
  • The "Loss Floor": In any discrete space (like finite elements), there is a minimum possible loss—the "floor"—that no model can go below. The authors show that the loss excess (current loss minus the floor) is the true metric that tracks the squared distance to the best possible numerical solution.
  • Stability is Local: For nonlinear problems, the residual-error guarantee isn't global. It holds within a "neighborhood" of a solution branch. The authors provide the conditions (stability and Lipschitz continuity) needed to define these safe zones.
  • Residual as an Error Estimator: Because of the proven equivalence, the training loss itself becomes a reliable error estimator at inference time. You don't need a ground-truth solution to know how well your model is performing.

Key Results

  • Superior Accuracy: In the PDE-compliant norm (which includes derivatives and fluxes), the RBNO achieved significantly higher accuracy than grid-based baselines like FNO, PCA-Net, and FC-PINO.
  • Reliable Error Tracking: The square root of the loss excess tracked the actual error within a factor of ~0.4 to ~3.0 across all benchmarks, mirroring the reliability of classical linear solvers.
  • Computational Efficiency: Training is efficient because it avoids full nonlinear PDE solves. Assembling the loss and gradient takes only 1/30 to 1/500 of the time required for a single traditional finite element solve. Once trained, inference takes mere milliseconds.

Limitations and Future Work

  • Branch Selection: The current loss function doesn't help the model choose between multiple valid solution branches if they exist; it simply finds the nearest one.
  • Conservative Constants: The theoretical error bounds use "worst-case" constants (like the minimum conductivity) which can make the estimates overly pessimistic in practice.
  • Localized Features: A single linear reduced space might struggle with problems featuring highly localized or moving features (like shock waves). The authors suggest that nonlinear or localized reduced representations could be a fruitful next step.
  • Active Learning: A promising future direction is using the residual at inference to automatically trigger "model enrichment" or corrections when the error estimate exceeds a threshold.

Summary updated

Abstract

Physics-informed operator learning trains neural operators on the residual of a parametric partial differential equation (PDE) instead of labeled solution data, but its reliability depends on a variationally correct residual: one that is equivalent to the error in a norm dictated by the equation, the PDE-compliant norm. For nonlinear equations written as first-order systems, we prove that the first-order system least-squares residual is equivalent to the error in this norm near a solution branch if the linearized residual is stable and the residual derivative is Lipschitz continuous, possibly in a norm stronger than the error norm. We verify these conditions for monotone reaction, solution- and gradient-dependent diffusion, and compressible Neo-Hookean hyperelasticity. The stability mechanisms vary across these classes, as do the regions where the equivalence holds, from arbitrary bounded sets to a neighborhood of the branch. In a conforming finite element space, we show that the loss excess of a state near the finite element solution is equivalent to its squared distance from that solution. We use this loss to train a reduced basis neural operator with values in this space, with solution snapshots needed only for the basis and the loss and its symbolically derived gradient assembled by the finite element library. At inference, this loss estimates the error. Numerically, the square root of the loss excess tracks the error within factors comparable to those of the linear case, and the operator achieves higher accuracy in the PDE-compliant norm than grid-based baselines evaluated in the same finite element space.
BibTeX
@misc{qiu2026variationally,
  author = {Yuan Qiu and Wolfgang Dahmen and Peng Chen},
  title = {{Variationally correct physics-informed operator learning for nonlinear partial differential equations}},
  year = {2026},
  eprint = {2611.21469},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.21469},
}
Figure