EPI-SST: Renewal-Structured State-Space Transformers for Epidemic Forecasting

Yiyun Chen, Zewen Liu, Shengpu Tang, Max S. Y. Lau, Wei JinarXiv 2026 · arXiv

TL;DR

EPI-SST is a novel forecasting framework that embeds the classical "renewal equation" of epidemiology directly into a State-Space Transformer. By combining the flexible representation learning of neural networks with the structural constraints of disease transmission, it achieves state-of-the-art accuracy and significantly more reliable uncertainty estimates across multiple infectious diseases.

What Problem Does This Paper Address?

Epidemic forecasting is a high-stakes task. Public health officials need to know not just the most likely number of hospitalizations, but also the "worst-case" scenarios to plan capacity.

Currently, forecasters face a trade-off. Mechanistic models (based on biological rules) are easy to interpret and respect the laws of physics/biology, but they are hard to scale and often struggle with complex, noisy data. Neural models (like LSTMs or Transformers) are incredibly flexible and can learn from vast amounts of data, but they are "black boxes" that can produce physically impossible trajectories or poorly calibrated uncertainty—often "drifting" into nonsensical predictions at longer time horizons.

The authors identify two specific gaps:

  1. Structured Horizon Coupling: Ensuring that a forecast for week 4 logically follows from the forecast for week 3 based on how diseases actually spread.
  2. Uncertainty-Scale Control: Preventing the model from simply "inflating" its uncertainty to hide errors in its mean prediction.

Methods

The authors propose EPI-SST (Epidemic State Space Transformer). Its architecture is a hybrid that treats the forecasting process as a latent state-space model (SSM) with a very specific transition rule.

  • The Encoder: It uses a PatchTST backbone, which breaks time-series data into "patches" to capture local semantic information, providing "evidence" for the forecast.
  • The Renewal Transition: Instead of a generic neural layer, the transition between forecast steps is governed by the renewal equation. This equation models how current incidence is a product of past cases and a time-varying reproduction number ($R_h$). The neural network predicts updates to this reproduction number rather than predicting the cases directly.
  • Bounded Neural Controls: To prevent the model from "hallucinating" massive surges, the updates to the internal multipliers are bounded and clipped.
  • Heteroscedastic Uncertainty Head: A separate branch predicts the variance ($\sigma^2$) of the forecast. Crucially, they use a log-variance penalty during training. This forces the model to maintain a consistent scale of uncertainty rather than letting the variance absorb the mean-model's errors.

Datasets

The model was evaluated on four major surveillance benchmarks from the EpiLearn library:

  1. COVID-19 Hospital Admissions (WHO data)
  2. COVID-19 Deaths (JHU data)
  3. Measles (Project Tycho)
  4. Mumps (Project Tycho)

Additionally, they performed a "stress test" using the 2019–2020 U.S. Influenza (WILI) season, which was considered "abnormal" due to the early disruption caused by the onset of COVID-19.

Key Insights and Ideas

  • Inductive Bias as a Transition Function: Most "hybrid" models use epidemiological rules as a loss function (soft constraint). EPI-SST uses the renewal equation as the actual architecture of the transition (hard constraint). This ensures the model's "internal logic" is always epidemiological.
  • Decoupling Mean and Variance: By separating the renewal branch (mean) from the emission head (variance), the model avoids a common pitfall where neural networks become "lazy" and just increase predicted variance when they encounter a hard-to-predict spike.
  • The Power of "Frozen-Path" Interventions: The authors proved the model actually "understands" the renewal logic. By manually perturbing the learned reproduction number ($R$) at a checkpoint, they showed the forecast shifted in the exact direction and magnitude predicted by epidemiological theory.

Key Results

EPI-SST consistently outperformed both pure neural baselines (like CNNs, LSTMs, and DLinear) and existing probabilistic models (like RNP and EpiFNP).

  • Point Accuracy: Reduced the Root Mean Squared Error (RMSE) by up to 14.2% compared to the strongest baseline.
  • Probabilistic Quality: Achieved the lowest Continuous Ranked Probability Score (CRPS)—a metric for both accuracy and calibration—across all datasets at mid-range horizons ($h=4, 5, 6$). In some cases, CRPS was reduced by 43%.
  • Robustness: During the volatile 2019-2020 flu season, EPI-SST reduced calibration error by a staggering 78.9%, showing it remains reliable even when the data deviates from historical patterns.

Limitations and Future Work

  • Fixed Lag Profiles: The current model uses a fixed "kernel" to represent how long it takes for one case to infect others. In reality, this can change (e.g., different variants or social distancing). Future versions could learn disease-specific or time-varying kernels.
  • Univariate Focus: The model currently forecasts one region/disease at a time. The authors suggest that multivariate emissions could help model dependencies across different regions or related pathogens.
  • Causal Inference: While the model uses an $R$ value, the authors caution that this is a "forecasting state" and shouldn't be used for causal policy claims (e.g., "Masking caused $R$ to drop") without further epidemiological identification.

Summary updated

Abstract

Epidemic forecasting supports public health decisions ranging from capacity planning to intervention timing, for which both point accuracy and calibrated uncertainty are essential. Although neural models have advanced point forecasting, producing reliable probabilistic predictions over multiple future horizons remains challenging. Renewal models encode epidemic propagation, while neural forecasters learn flexible multi-horizon representations; integrating these strengths within a probabilistic future rollout remains underexplored. We propose EPI-SST (Epidemic State Space Transformer), a probabilistic forecaster centered on an evidence-driven renewal transition. At each horizon, neural evidence produces a bounded update to an internal multiplier and advances a finite-memory renewal state that generates the future mean trajectory. A separate heteroscedastic Gaussian head controls predictive scale using a validation-selected log-variance penalty. Across four epidemic surveillance benchmarks, EPI-SST achieves the lowest pooled RMSE on every dataset, reducing RMSE by up to 14.2 percent relative to the strongest baseline. It also achieves the lowest continuous ranked probability score (CRPS) at horizons h = 4, 5, 6 on every dataset, with reductions of up to 43 percent relative to the strongest probabilistic baseline. During the abnormal 2019-2020 influenza season, EPI-SST reduces CRPS by 16.9 percent and calibration error by 78.9 percent; a three-seed replication preserves its distributional lead. Ablation studies and frozen-path interventions show that the renewal transition, attention conditioning, horizon coupling, and uncertainty-scale control make complementary contributions to predictive performance.
BibTeX
@misc{chen2026epi,
  author = {Yiyun Chen and Zewen Liu and Shengpu Tang and Max S. Y. Lau and Wei Jin},
  title = {{EPI-SST: Renewal-Structured State-Space Transformers for Epidemic Forecasting}},
  year = {2026},
  eprint = {2611.20352},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.20352},
}
Figure