Amortized Control of Continuous State Space Feynman-Kac Model for Irregular Time Series

Byoungwoo Park, Hyungi Lee, Juho Lee

TL;DR

Modeling irregular time series usually requires slow, sequential Bayesian updates that scale poorly with sequence length. This paper introduces ACSSM (Amortized Control of continuous State Space Model), which reformulates continuous-time posterior inference as a stochastic optimal control problem using a novel multi-marginal Doob’s $h$-transform. By combining locally linear SDEs with a transformer-based parallel scan algorithm, ACSSM achieves state-of-the-art accuracy while training 16× to 25× faster than existing simulation-based models.

What Problem Does This Paper Address?

From electronic health records to climate monitoring, real-world data is rarely collected at perfectly uniform intervals. Continuous-Discrete State Space Models (CD-SSMs) use Stochastic Differential Equations (SDEs) to model these irregular gaps naturally.

However, standard CD-SSMs suffer from a major computational bottleneck: they rely on sequential Bayesian recursion (filtering and smoothing) to infer latent states. This means the computational cost scales linearly with the number of observations ($O(k)$), and calculating gradients requires backpropagating through slow, numerically unstable SDE solvers (like Euler-Maruyama). As a result, scaling these models to long sequences or high-dimensional spaces is incredibly difficult.

Methods

ACSSM bypasses sequential recursion entirely by framing variational inference as a Stochastic Optimal Control (SOC) problem.

Conceptual illustration of the ACSSM framework

Here is how the architecture works:

  1. Amortized Latent Space: An encoder maps high-dimensional, irregularly sampled observations into a lower-dimensional latent space populated by auxiliary variables.
  2. Multi-Marginal Doob's $h$-Transform: The authors extend the classical Doob's $h$-transform—traditionally used to condition a process on a single terminal state—to handle multiple discrete observation constraints across time.
  3. Locally Linear SDEs: To avoid slow numerical SDE simulations, the drift function is parameterized as locally linear between observation intervals. This mathematical choice unlocks a simulation-free property, allowing the model to compute exact Gaussian marginal distributions analytically.
  4. Parallelized Inference: Because the local dynamics are linear, the authors integrate a parallel scan algorithm with a transformer architecture. This reduces the temporal complexity from $O(k)$ to $O(\log k)$, enabling parallel computation of the Evidence Lower Bound (ELBO) and latent states.

The framework supports two information assimilation schemes via masked attention: History (filtering based on past data) and Full (smoothing based on the entire sequence).

Two types of information assimilation schemes

Datasets

The authors evaluated ACSSM across four diverse time-series benchmarks:

  • Human Activity: 6,554 sequences of 3D sensor positions for classifying time points into 7 distinct physical activities.
  • Pendulum Regression: A sequence of noisy images where the goal is to infer the underlying sine and cosine of a pendulum's angle.
  • USHCN: Daily weather measurements (precipitation, snowfall, etc.) from 1,168 stations across the US, heavily subsampled to introduce irregularity.
  • Physionet: 8,000 multivariate clinical time-series from ICU patients containing 37 time-varying features recorded over 48 hours.

Key Insights and Ideas

  • The SOC-VI Bridge: The paper establishes a fundamental connection between the partial differential equations (PDEs) of Doob's $h$-transform and Stochastic Optimal Control. This allows them to derive a mathematically rigorous, exceptionally tight ELBO.
  • Linearity Breeds Speed: By restricting the latent drift matrices to be semi-positive definite and diagonalized via eigen-decomposition, the authors bypass matrix exponentials and numerical integrations. Local linearity turns an intractable simulation problem into an analytical one.
  • Breaking the Sequential Barrier: Combining the simulation-free property with a parallel scan algorithm allows the model to process time steps concurrently, a massive departure from traditional recurrent or Kalman-filtering-based CD-SSMs.

Key Results

ACSSM consistently outperformed strong baselines (including Latent-ODE, Latent-SDE, mTAND, and CRU) across classification, regression, interpolation, and extrapolation tasks.

  • Accuracy & Regression: On the Human Activity dataset, ACSSM achieved a top test accuracy of 91.4%. In the Pendulum Regression task, it achieved the lowest Mean Squared Error (2.98 × $10^{-3}$), proving that the locally linear approximation does not sacrifice the model's ability to capture highly non-linear physical systems.
  • Massive Speedups: When benchmarked on identical hardware (a single NVIDIA RTX A6000), ACSSM demonstrated a training runtime that was 16× to 25× faster per epoch than the Continuous Recurrent Unit (CRU) model.

Limitations and Future Work

While highly effective, the authors note a few open challenges:

  • Cumulative Linearization Errors: The variational gap introduced by the locally linear approximation could potentially compound over very long time horizons (e.g., when applying this to Large Language Models).
  • High Reliance on Network Capacity: Unlike Sequential Monte Carlo (SMC) methods that use particle-based importance weighting to correct approximation errors, ACSSM relies entirely on the capacity of its neural networks to accurately learn the optimal control function.

As a next step, the authors suggest exploring multi-agent dynamics approaches (incorporating multiple controls) to improve the model's flexibility and robustness.

Summary updated

Abstract

Many real-world datasets, such as healthcare, climate, and economics, are often collected as irregular time series, which poses challenges for accurate modeling. In this paper, we propose the Amortized Control of continuous State Space Model (ACSSM) for continuous dynamical modeling of time series for irregular and discrete observations. We first present a multi-marginal Doob's $h$-transform to construct a continuous dynamical system conditioned on these irregular observations. Following this, we introduce a variational inference algorithm with a tight evidence lower bound (ELBO), leveraging stochastic optimal control (SOC) theory to approximate the intractable Doob's $h$-transform and simulate the conditioned dynamics. To improve efficiency and scalability during both training and inference, ACSSM leverages auxiliary variable to flexibly parameterize the latent dynamics and amortized control. Additionally, it incorporates a simulation-free latent dynamics framework and a transformer-based data assimilation scheme, facilitating parallel inference of the latent states and ELBO computation. Through empirical evaluations across a variety of real-world datasets, ACSSM demonstrates superior performance in tasks such as classification, regression, interpolation, and extrapolation, while maintaining computational efficiency.
BibTeX
@inproceedings{park2025amortized,
  author = {Byoungwoo Park and Hyungi Lee and Juho Lee},
  title = {{Amortized Control of Continuous State Space Feynman-Kac Model for Irregular Time Series}},
  booktitle = {International Conference on Learning Representations},
  year = {2025},
  url = {https://openreview.net/forum?id=8zJRon6k5v},
}
Figure