Daily Forecasting of New Cases for Regional Epidemics of Coronavirus Disease 2019 with Bayesian Uncertainty Quantification

Yen Ting Lin, Jacob Neumann, Ely Miller, Richard G. Posner, Abhishek Mallela, Cosmin Safta, Jaideep Ray, Gautam Thakur, Supriya Chinthavali, William S. HlavacekarXiv 2020 · DOI · arXiv

TL;DR

Researchers from Los Alamos National Laboratory and partner institutions developed a daily "online learning" framework that uses Bayesian inference to forecast COVID-19 cases across 15 major US metropolitan areas. By combining mechanistic compartmental models with rigorous uncertainty quantification, the system can distinguish between routine reporting noise and "upward-trending anomalies," providing an early warning signal when social distancing measures begin to lapse.

What Problem Does This Paper Address?

Epidemiological forecasting is notoriously difficult because of two factors: the inherent "noise" in how cases are reported (weekends vs. weekdays, testing backlogs) and the fact that human behavior—specifically social distancing—changes over time.

Most models are static or updated infrequently, making them slow to react when a population shifts from "stay-at-home" mode to "re-opening" mode. The authors sought to create a system that provides "situational awareness" for policymakers by identifying new upward trends as they happen, rather than weeks after the fact. They also argue that modeling Metropolitan Statistical Areas (MSAs) is more effective than modeling entire states, as city-dwellers share more uniform social and economic interactions.

Methods

The team employed a dual-modeling approach, updated daily via Bayesian inference:

  1. The Curve-Fitting Model: A phenomenological model using a Gamma distribution to capture the "fast growth, slow decay" shape of typical epidemic waves. It’s simple but less flexible for complex, multi-wave scenarios.
  2. The Mechanistic Compartmental Model: A sophisticated system of 25 Ordinary Differential Equations (ODEs). Unlike a standard SEIR model, this one splits the population into "mixing" (no precautions) and "protected" (social distancing) groups. It accounts for asymptomatic carriers, varying stages of incubation, and different disease severities.

The Secret Sauce: Online Learning & UQ The researchers used Adaptive Markov Chain Monte Carlo (MCMC) to estimate model parameters. To make daily updates computationally feasible, they used "warm-starting"—using the previous day’s best estimates to initialize the next day’s simulation. They used a Negative Binomial distribution to model reporting noise, allowing them to calculate "credible intervals." If new data points fall above the 97.5th percentile for two consecutive days, the system flags an "upward-trending anomaly."

Datasets

  • Primary Data: COVID-19 surveillance data (daily new confirmed cases) from The New York Times GitHub repository, which aggregates state and local health agency reports.
  • Scope: The 15 most populous US MSAs, including New York City, Los Angeles, Chicago, Phoenix, and others.
  • Demographics: Population totals were pulled from the US Census Bureau to parameterize the initial susceptible populations ($S_0$).

Key Insights and Ideas

  • MSAs > States: The paper demonstrates that case counts within an MSA (like NYC) are more temporally correlated than counts across an entire state (like New York State). This suggests that the city-level is the "natural" scale for epidemic modeling.
  • Anomalies as Harbingers: The authors define a "rare event" as a data point outside the 95% credible interval. Two such events in a row (an "anomaly") suggest the current model is no longer predictive because the underlying transmission rate has changed.
  • The "Relaxation" Signature: In Phoenix, the model initially failed to explain a June surge. By adding a second "phase" to the social distancing parameter, the model showed that the surge was perfectly explained by a drop in social distancing adherence (from ~49% to ~38%).
  • Mass Gatherings vs. Sustained Behavior: Through simulations, the authors found that one-time mass gatherings cause a "step up" in cases but don't change the slope of the curve. Sustained upward trends are almost always driven by a fundamental change in daily social distancing behavior.

Key Results

  • Early Detection: The model successfully inferred significant upward trends in five MSAs (Houston, Miami, Phoenix, San Francisco, and Seattle) between April and June 2020.
  • Quantifiable Behavioral Shifts: In Phoenix, the MAP (Maximum A Posteriori) estimate for the start of the "relaxation" period was identified as May 24, 2020, which preceded the visible explosion of cases in June.
  • Short-term Accuracy: The study proved that while long-term forecasting is a "fool's errand" due to behavioral shifts, accurate short-term (1–5 day) predictions are highly achievable if the model is updated daily.

Limitations and Future Work

  • Coarse Behavioral Metrics: While the model can detect that social distancing has relaxed, it cannot distinguish which specific behaviors (e.g., indoor dining vs. lack of masking) are responsible.
  • Symptomatic Bias: The measurement model assumes most detected cases are symptomatic. If a region shifts heavily toward testing asymptomatic individuals, the model’s "detection fraction" ($f_D$) might need adjustment.
  • Deterministic Core: The underlying ODEs are deterministic. While the Bayesian framework adds a layer of stochasticity to the outputs, the transmission dynamics themselves don't account for random "superspreader" events at the individual level.
  • Future Direction: The authors suggest that integrating mobility data (like cell phone pings) could further refine the social distancing parameters.

Summary updated

Abstract

To increase situational awareness and support evidence-based policy-making, we formulated two types of mathematical models for COVID-19 transmission within a regional population. One is a fitting function that can be calibrated to reproduce an epidemic curve with two timescales (e.g., fast growth and slow decay). The other is a compartmental model that accounts for quarantine, self-isolation, social distancing, a non-exponentially distributed incubation period, asymptomatic individuals, and mild and severe forms of symptomatic disease. Using Bayesian inference, we have been calibrating our models daily for consistency with new reports of confirmed cases from the 15 most populous metropolitan statistical areas in the United States and quantifying uncertainty in parameter estimates and predictions of future case reports. This online learning approach allows for early identification of new trends despite considerable variability in case reporting. We infer new significant upward trends for five of the metropolitan areas starting between 19-April-2020 and 12-June-2020.
BibTeX
@misc{lin2020daily,
  author = {Yen Ting Lin and Jacob Neumann and Ely Miller and Richard G. Posner and Abhishek Mallela and Cosmin Safta and Jaideep Ray and Gautam Thakur and Supriya Chinthavali and William S. Hlavacek},
  title = {{Daily Forecasting of New Cases for Regional Epidemics of Coronavirus Disease 2019 with Bayesian Uncertainty Quantification}},
  year = {2020},
  eprint = {2007.12523},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2007.12523},
}
Figure