Data-Driven, ML-assisted Approaches to Problem Well-Posedness

Tom Bertalan, George A. Kevrekidis, Eleni D. Koronaki, Siddhartha Mishra, Elizaveta Rebrova, Yannis G. KevrekidisarXiv 2025 · DOI · arXiv

Abstract

Traditional numerical analysis requires well-posed differential equations with precise boundary conditions to ensure existence and uniqueness. This paper introduces a data-driven framework to probe well-posedness experimentally using Physics-Informed Neural Networks (PINNs) and randomized sampling. By analyzing the variance and dimensionality of solution ensembles via Principal Component Analysis (PCA), the authors demonstrate the ability to map regions of uniqueness and identify missing physical constraints in under-determined systems.

Introduction

The concept of well-posedness—existence and uniqueness of a solution—is fundamental to solving differential equations. However, real-world applications often involve "patchy" or contradictory data that defy classical theoretical guarantees. This work proposes a shift from abstract proofs to numerical probing. By treating the PDE as an optimization problem solved repeatedly with randomized initializations, we can identify which parts of a domain are physically determined and which remain "free."

Methodology

The core approach utilizes an ensemble of Physics-Informed Neural Networks (PINNs). Each network is trained to minimize a loss function combining the PDE residual (the physical law) and available data constraints. By solving the same problem hundreds of times with different random seeds, the method generates a "cloud" of potential solutions.

Principal Component Analysis (PCA) is then applied to these solution ensembles. The dimensionality of the resulting subspace indicates the number of degrees of freedom or "missing constraints" in the problem. For over-constrained scenarios, the authors employ randomized linear algebra techniques, such as the Quantile Subspace Constrained Randomized Kaczmarz, to isolate consistent data subsets from contradictory inputs.

Experimental Validation

Harmonic Oscillator

The method was first validated on a second-order harmonic oscillator. When the system is under-constrained (e.g., zero or one initial condition), the PINN ensemble exhibits high variance, forming a manifold of physically valid solutions.

Ensembles of solutions for the harmonic oscillator under different constraint levels (IVP-2 vs IVP-3). High variance in IVP-3 indicates an under-constrained problem.

PCA successfully recovered the 1D and 2D null spaces corresponding to the missing initial conditions, demonstrating that the "richness" of the solution set directly reflects the degree of ill-posedness.

The Wave Equation

In the context of the linear wave equation, the framework was used to map how information propagates from a localized data "patch." The resulting variance maps align with the theoretical method of characteristics.

Mapping well-posedness in the Wave Equation. The left panels show the domain and physical characteristics; the right panels show the linear relationship between PCA components and the box perimeter p.

Regions where multiple characteristics intersect with the data patch show low variance (uniqueness), while regions with fewer intersections remain partially free. The PCA analysis showed a predictable growth in the dimension of the solution set based on the number of unanchored characteristics.

Key Insights and Discussion

A key insight is that variance serves as a diagnostic tool: low variance indicates well-posedness, while high variance highlights under-determined regions. Unlike standard data assimilation, which seeks a single "best" solution, this approach explores the entire family of possible solutions to reveal the underlying physical structure. Furthermore, the method proves robust in handling "adversarial" or inconsistent data by identifying and discarding problematic constraints to recover a consistent model.

Conclusion and Future Work

While promising, the computational cost of training hundreds of PINNs is significant. Future research aims to optimize this pipeline for high-dimensional industrial simulations and to bridge the gap between these discrete numerical probes and rigorous continuous mathematical proofs. The ultimate goal is an automated system that can advise researchers on where additional data collection is most critical to achieve well-posedness.

Summary updated

BibTeX
@misc{bertalan2025data,
  author = {Tom Bertalan and George A. Kevrekidis and Eleni D. Koronaki and Siddhartha Mishra and Elizaveta Rebrova and Yannis G. Kevrekidis},
  title = {{Data-Driven, ML-assisted Approaches to Problem Well-Posedness}},
  year = {2025},
  eprint = {2503.19255},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2503.19255},
}
Figure