Physics-informed neural networks for inverse problems in supersonic flows

Ameya D. Jagtap, Zhiping Mao, Nikolaus A. Adams, George Em Karniadakis

This paper, authored by researchers from Brown University, Xiamen University, and the Technical University of Munich, presents a robust framework for solving inverse problems in supersonic aerodynamics using Physics-Informed Neural Networks (PINNs).

TL;DR

The researchers demonstrate that Physics-Informed Neural Networks (PINNs) and their domain-decomposed variant (XPINNs) can accurately reconstruct complex supersonic flow fields—including shocks and expansion waves—from sparse experimental data like Schlieren photography. By enforcing entropy conditions and positivity constraints, the models successfully navigate "ill-posed" inverse problems that traditional CFD solvers struggle to handle.

What Problem Does This Paper Address?

Designing high-speed aerospace vehicles requires precise knowledge of flow fields (density, pressure, and velocity). However, in experimental settings, we often only have "partial" data, such as density gradients from Schlieren imaging or sparse sensor readings at the inlet.

Reconstructing the full flow field from this limited data is an inverse problem. These are notoriously "ill-posed," meaning they may not have a unique solution or are highly sensitive to noise. Traditional Computational Fluid Dynamics (CFD) solvers are poorly suited for this because they typically require well-defined boundary conditions (like outflow conditions) for all variables, which are often unknown in real-world testing.

Methods

The authors employ two primary architectures:

  1. PINNs: A standard neural network where the loss function is "informed" by the governing compressible Euler equations.
  2. XPINNs (Extended PINNs): A domain-decomposition approach where the physical space is divided into subdomains, each handled by a separate neural network. This allows for greater "expressivity" in regions with complex physics, such as near a shock wave.

Key Innovations: * Entropy Conditions: To ensure the model converges to a physically valid "viscosity solution" (rather than a non-physical mathematical artifact), the authors enforce an entropy inequality constraint. * Adaptive Activations: They use "layer-wise adaptive activation functions" where the slope of the activation (e.g., tanh) is a trainable parameter, significantly speeding up convergence. * Dynamic Weighting: The loss function balances multiple terms (PDE residuals, data mismatch, boundary conditions). The authors use a dynamic weighting strategy to automatically adjust these balances during training. * Positivity Constraints: They enforce a max(alpha, variable) constraint to prevent the model from predicting non-physical negative values for density or pressure.

Datasets

The study uses synthetic data generated to mimic real-world experimental constraints:

  • Schlieren Data: 340 to 1,200 points of density gradient ($\nabla \rho$) information.
  • Inlet/Wall Data: Sparse points (approx. 100) for primitive variables at the inflow and a few pressure points on the vehicle surface.
  • Reference Solutions: For validation, the authors compared results against exact solutions derived from isentropic relations, shock-jump conditions, and high-fidelity CFD data (specifically for the bow shock case).

Key Insights and Ideas

  • Schlieren as a Constraint: The paper highlights that density gradients—which are relatively easy to capture experimentally—provide a powerful mathematical constraint that allows PINNs to "see" the structure of shocks and expansion fans.
  • The Necessity of Entropy: Without enforcing entropy conditions, neural networks can satisfy the Euler equations but produce non-physical results. The entropy fix acts as a crucial "physics-based regularizer."
  • XPINN Generalization: The authors use Rademacher complexity (a theoretical measure of a model's ability to fit random noise) to show that XPINNs generalize better than standard PINNs. By breaking the problem into simpler sub-problems, each local network is less prone to overfitting.
  • Boundary Condition Independence: Unlike traditional solvers, PINNs do not require outflow boundary conditions, making them far more flexible for assimilating experimental data where the "exit" state of the flow is unknown.

Key Results

The models were tested on three classic supersonic scenarios:

  • Expansion Waves: XPINNs achieved a relative $L_2$ error in density of $3.38 \times 10^{-3}$, outperforming standard PINNs.
  • Oblique Shocks: While "vanilla" PINNs struggled with the sharp discontinuities of a shock, the versions using adaptive activations and XPINNs captured the shock jump with high precision (errors around $5.3 \times 10^{-3}$ for density).
  • Bow Shocks: In the most complex case (flow around a cylinder), XPINNs demonstrated superior predictive accuracy over standard PINNs, particularly in capturing the curved "detached" shock structure.

Limitations and Future Work

  • Prior Knowledge for XPINNs: Currently, the decomposition of subdomains in XPINNs requires some human intuition about where the complex physics (like shocks) will occur.
  • Computational Cost: While PINNs are flexible, training them is generally more computationally expensive than a single forward run of a traditional CFD solver.
  • Inviscid Assumption: This work focuses on the Euler equations (inviscid flow). The authors note that future work should extend this to the Navier-Stokes equations to account for viscosity and turbulence, which are critical for real-world aerospace design.
  • Dimensionality: The study is limited to 2D flows; moving to 3D will significantly increase the complexity of the coordinate space and training time.

Summary updated

Abstract

Accurate solutions to inverse supersonic compressible flow problems are often required for designing specialized aerospace vehicles. In particular, we consider the problem where we have data available for density gradients from Schlieren photography as well as data at the inflow and part of wall boundaries. These inverse problems are notoriously difficult and traditional methods may not be adequate to solve such ill-posed inverse problems. To this end, we employ the physics-informed neural networks (PINNs) and its extended version, extended PINNs (XPINNs), where domain decomposition allows deploying locally powerful neural networks in each subdomain, which can provide additional expressivity in subdomains, where a complex solution is expected. Apart from the governing compressible Euler equations, we also enforce the entropy conditions in order to obtain viscosity solutions. Moreover, we enforce positivity conditions on density and pressure. We consider inverse problems involving two-dimensional expansion waves, two-dimensional oblique and bow shock waves. We compare solutions obtained by PINNs and XPINNs and invoke some theoretical results that can be used to decide on the generalization errors of the two methods.
BibTeX
@misc{jagtap2022physics,
  author = {Ameya D. Jagtap and Zhiping Mao and Nikolaus A. Adams and George Em Karniadakis},
  title = {{Physics-informed neural networks for inverse problems in supersonic flows}},
  year = {2022},
  eprint = {2202.11821},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2202.11821},
}
Figure