Adaptive and hybrid reduced order models to mitigate Kolmogorov barrier in a multiscale kinetic transport equation

Tianyu Jin, Zhichao Peng, Yang Xiang

TL;DR

Researchers have developed a new hybrid approach to speed up simulations of multiscale kinetic transport equations, which are notoriously difficult to compress. By combining an adaptive "piecewise linear" strategy with targeted deep learning (autoencoders), they successfully bypassed the "Kolmogorov barrier"—a fundamental limit that usually makes traditional reduced-order models inefficient for transport-dominated problems.

What Problem Does This Paper Address?

Simulating how particles move and interact with a medium—governed by the Radiative Transfer Equation (RTE)—is a computational nightmare. Because these equations live in a high-dimensional "phase space" (position plus velocity), a single high-fidelity simulation can take hours or days.

Engineers often use Reduced Order Models (ROMs) to create a "cheat sheet" of the solution, allowing them to predict new scenarios in seconds. However, when a system is "transport-dominated" (meaning particles move quickly with little scattering), it hits the Kolmogorov barrier. In these cases, the solution manifold is so complex that traditional linear methods (like Proper Orthogonal Decomposition, or POD) require a massive number of basis functions to maintain accuracy, defeating the purpose of the "reduced" model.

Methods

The authors propose a two-stage solution to break through this barrier:

  1. Goal-Oriented Adaptive Time Partitioning: Instead of using one global linear model for the entire simulation, they chop the timeline into intervals. Crucially, their algorithm doesn't just refine (split) intervals that are too complex; it also coarsens (merges) intervals that are simple. It even includes an equilibrium detection step to use ultra-low-dimensional models once the system reaches a steady state.
  2. The Hybrid ROM: For the most "stubborn" time intervals—where even piecewise linear models struggle (like the propagation of a sharp delta function)—the authors swap out the linear model for a nonlinear Convolutional Autoencoder (AE).
  3. Why this is clever: Training an AE is computationally expensive. By only applying it to the specific time windows that actually need it, they get the compression power of deep learning without the massive "offline" training overhead of a global neural network model.

Datasets

The researchers evaluated their methods using three increasingly complex numerical benchmarks:

  • Example 1: Two-Material Problem (1D): Particles moving from a vacuum into a high-scattering region.
  • Example 2: Three-Material Problem with Source (1D): A more complex setup involving internal sources and varying scattering coefficients.
  • Example 3: Pin-Cell Problem (2D): A classic nuclear engineering benchmark simulating a fuel pin, creating significant multiscale effects between the "inner" and "outer" regions.

Key Insights and Ideas

  • Coarsening is Key: Most adaptive ROMs only split intervals. By adding a merging (coarsening) strategy, the authors prevent "memory bloat," ensuring the model stays lean and fast.
  • Equilibrium as a Shortcut: In long-term simulations, systems eventually settle down. Recognizing this allows the model to drop from dozens of basis functions to just one or two, drastically saving time.
  • Selective Nonlinearity: The "aha moment" is realizing that you don't need deep learning for the whole problem. Linear models are great for diffusion; Autoencoders are great for sharp transport features. The hybrid approach uses the right tool for the right time window.

Key Results

  • Speedups: In the 1D three-material problem, the Hybrid AE method achieved an 88% reduction in online computational time compared to standard POD.
  • Efficiency: In the 2D Pin-Cell problem, the hybrid approach was significantly faster than both classical POD and uniform partitioning while maintaining comparable (or better) accuracy.
  • Accuracy: The adaptive models consistently outperformed traditional methods in capturing "unseen" parameter values, proving they aren't just memorizing the training data but actually learning the underlying physics.

Limitations and Future Work

  • Theoretical Gaps: While the method works empirically, the authors note that the mathematical relationship between time partitioning and the decay rate of the Kolmogorov $n$-width is still not fully understood.
  • Generalization Errors: There is still work to be done on understanding the "generalization error" of autoencoders in this context—essentially, how well the neural network performs when the physics parameters change drastically.
  • Online Strategy: The current "non-intrusive" online stage relies on interpolation; the authors suggest that developing a more robust projection-based online strategy could further improve reliability.

Summary updated

Abstract

In this work, we develop reduced order models (ROMs) to predict solutions to a multiscale kinetic transport equation with a diffusion limit under the parametric setting. When the underlying scattering effect is not sufficiently strong, the system governed by this equation exhibits transport-dominated behavior. Suffering from the Kolmogorov barrier for transport-dominant problems, classical linear ROMs may become inefficient in this regime. To address this issue, we first develop a piecewise linear ROM by introducing a novel goal-oriented adaptive time partitioning strategy. To avoid local over-refinement or under-refinement, we propose an adaptive coarsening and refinement strategy that remains robust with various initial empirical partitions. Additionally, for problems where a local linear approximation is not sufficiently efficient, we further develop a hybrid ROM, which combines autoencoder-based nonlinear ROMs and piecewise linear ROMs. Compared to previous autoencoder-based ROMs, this hybridized method reduces the offline autoencoder's training cost by only applying it to time intervals that are adaptively identified as the most challenging. Numerical experiments demonstrate that our proposed approaches successfully predict full-order solutions at unseen parameter values with both efficiency and accuracy. To the best of our knowledge, this is the first attempt to address the Kolmogorov barrier for multiscale kinetic transport problems with the coexistence of both transport- and diffusion-dominant behaviors.
BibTeX
@misc{jin2025adaptive,
  author = {Tianyu Jin and Zhichao Peng and Yang Xiang},
  title = {{Adaptive and hybrid reduced order models to mitigate Kolmogorov barrier in a multiscale kinetic transport equation}},
  year = {2025},
  eprint = {2505.08214},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2505.08214},
}
Figure