The Right Measure for Physics-Constrained Generation: A Co-Area Correction for Posterior-Consistent PDE Inverse Problems

Jian Xu, Yanning Wu, Delu Zeng, John Paisley, Qibin ZhaoarXiv 2026 · arXiv

TL;DR

Current generative models for solving PDE inverse problems enforce physics as a hard constraint post-hoc, but this paper reveals they sample the wrong distribution due to a measure-theoretic oversight known as the Borel-Kolmogorov paradox. By introducing a co-area (Fixman) Jacobian correction, the authors present CoCoS, a sampler that restores true Bayesian posterior consistency and accurate uncertainty quantification.

What Problem Does This Paper Address?

When using diffusion or flow-matching models to solve partial differential equation (PDE) inverse problems, researchers often force the generated samples to exactly satisfy physical laws (like conservation of mass or boundary conditions). This is typically done post-hoc by projecting samples onto a valid "physics manifold" or using residual guidance.

However, because a hard constraint defines a zero-measure manifold in the state space, conditioning on it is mathematically ambiguous—a classic conundrum known as the Borel-Kolmogorov paradox. The physically meaningful approach assumes the PDE holds up to an infinitesimally small noise residual. Standard projection methods instead target a geometric "Euclidean limit," completely omitting a crucial co-area Jacobian factor (the Fixman correction). As a result, "satisfying the physics" does not mean you are correctly "sampling the posterior," leading to severely miscalibrated uncertainty estimates.

Figure 1: The measure problem, and CoCoS fixes it. (a) Conditioning a prior (gray cloud) on the hard-constraint manifold M yields a posterior whose uncertainty (red band) varies along M: tight where the constraint is sensitive (steep) and broad where it is flat—the co-area weighting [det(JJ⊤)]−1/2. (b) Resulting density on M in a controlled 2D example (constraint y=f(x)): CoCoS (green) recovers the true posterior (i.i.d. arbiter, shaded), whereas minimal-displacement projection (PCFM, blue dashed) systematically misplaces posterior mass—piling it where the manifold is flat and depleting the sensitive regions.

Methods

The authors propose CoCoS (Co-Area Constrained Sampling), an exact manifold MCMC sampler. Unlike standard projection methods that minimize Euclidean displacement, CoCoS explicitly incorporates the missing co-area weight into a Boltzmann potential:

$$V(x) = -\log \pi(x) - \log \ell(y|x) + \frac{1}{2}\log \det(J(x)J(x)^\top)$$

where $J$ is the constraint Jacobian, $\pi(x)$ is the prior, and $\ell(y|x)$ is the likelihood. It uses an isotropic tangent step proposal followed by a normal re-projection and a reverse-projection check to guarantee mathematical reversibility and exactness.

To bypass the high computational cost of test-time MCMC and Jacobian evaluations, they also introduce CoCo-Flow, an amortized version that distills the exact sampler into a conditional flow-matching model during training, allowing for instant inference.

Datasets

The methods were evaluated using a set of synthetic and physical PDE inverse problem benchmarks:

  • A controlled 4D toy benchmark with a single non-linear quadratic constraint to isolate measure effects from PDE solver artifacts.
  • A 1D Darcy Flow inverse problem (reconstructing log-permeability fields from sparse pressure observations) evaluated at dimensions $d=8$ and $d=16$.
  • A 1D Steady Viscous Burgers inverse problem to test scenarios with mild sensitivity variation.
  • A high-dimensional 2D Darcy Flow field-valued problem ($d=64$).

To evaluate accuracy without MCMC mixing bias, the authors implemented an i.i.d. rejection arbiter (residual-band rejection) to serve as the ground truth.

Key Insights and Ideas

  • Geometry vs. Probability: Standard projection methods pile up samples where the constraint manifold is "flat" (low sensitivity) and deplete them where it is "steep" (high sensitivity). The co-area correction properly down-weights highly sensitive regions to match the physical residual-noise limit.
  • Spurious Correlations: Omitting the Fixman factor doesn't just cause a minor shift; it fundamentally distorts the posterior covariance structure, creating entirely artificial correlations between variables that do not exist in the true posterior.
  • Amortization Saves the Day: Forward-simulation-based training (generating data pairs via the forward model) naturally avoids this bias because it never explicitly conditions on a zero-measure manifold. CoCo-Flow leverages this to deliver calibrated posteriors in a single forward pass at test time.

Key Results

  • Error Inflation: In the 4D benchmark, omitting the Fixman factor inflated the posterior error to 21$\times$ the sampling noise floor, while standard minimal-displacement projection (PCFM) sat at 9$\times$ the floor. CoCoS successfully matched the ground-truth floor.
  • Covariance Distortion: On the 1D Darcy Flow problem ($d=8$), standard projection methods distorted the covariance matrix by 122% error and miscalculated the posterior standard deviation by 96%. CoCoS reduced covariance error to just 5%.
Figure 2: Posterior covariance Σ over the d=8 Darcy coefficients (shared colour scale). CoCoS reproduces the arbiter’s covariance structure (Frobenius error 5%); no-Fixman is close (10%); minimal-displacement projection (PCFM) distorts it badly (122%), manufacturing spurious correlations and inflated variances. The bias is a covariance-level error, not just a marginal one.
  • Field-Scale Scaling: For the 2D Darcy Flow problem ($d=64$), the constraint sensitivity varied by over five orders of magnitude ($2.6 \times 10^5\times$). In this highly heterogeneous regime, CoCo-Flow successfully recovered the true posterior in the data-constrained subspace, while standard projection remained heavily biased.

Limitations and Future Work

  • Computational Cost: The exact CoCoS sampler requires computing the constraint Jacobian $J$ and an $m \times m$ log-determinant at every step, which becomes expensive when the number of constraints ($m$) is very large.
  • Scaling Amortization: While CoCo-Flow successfully shifts this computational burden to training time, fully scaling it to handle arbitrary observation operators and extremely high-dimensional field-valued parameters remains an open direction for future engineering optimization.

Summary updated

Abstract

Generative models -- diffusion and flow matching -- are increasingly used to solve partial differential equation (PDE) inverse problems, enforcing the governing physics as a \emph{hard constraint} (via projection or guidance) and reporting the resulting samples as a Bayesian posterior with calibrated uncertainty. We show that this widely adopted recipe samples the wrong distribution. Conditioning a generative prior on a hard PDE constraint is conditioning on a measure-zero manifold -- an operation that is intrinsically ambiguous (the Borel--Kolmogorov paradox) and whose physically correct resolution, the small-residual-noise limit, carries a co-area (Fixman) Jacobian factor $[det(JJ^{\top})]^{-1/2}$ that projection- and guidance-based methods silently omit. We make the bias precise, show that it grows with the heterogeneity of the constraint sensitivity, and validate it on controlled problems against an \emph{i.i.d.} ground-truth arbiter. The omitted factor is not a second-order detail: removing it inflates the posterior error to $20\times$ the sampling-noise floor; minimal-displacement projection (as in PCFM) is biased at $9\times$ the floor; and a naive scalar reweighting does not fix it. We introduce \textbf{CoCoS}, a measure-aware constrained sampler that targets the correct co-area posterior, and show that it matches the gold-standard posterior to within sampling noise. Our results imply that ``satisfying the physics'' is not the same as ``sampling the posterior,'' and give a principled correction for uncertainty-aware scientific inference.
BibTeX
@misc{xu2026right,
  author = {Jian Xu and Yanning Wu and Delu Zeng and John Paisley and Qibin Zhao},
  title = {{The Right Measure for Physics-Constrained Generation: A Co-Area Correction for Posterior-Consistent PDE Inverse Problems}},
  year = {2026},
  eprint = {2606.04804},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2606.04804},
}

Loading related content...

Figure