A generalized forecasting solution to enable future insights of COVID-19 at sub-national level resolutions

Umar Marikkar, Harshana Weligampola, Rumali Perera, A. S. Jameel Hassan, Suren Sritharan, Gihan Jayatilaka, Roshan Godaliyadda, Vijitha R. Herath, Parakrama Ekanayake, Janaka Ekanayake, Anuruddhika Rathnayake, Samath DharmaratnearXiv 2021 · arXiv

Introduction

Effective public health responses to a pandemic require more than just national-level trends; they demand granular, sub-national insights. While national forecasts are useful for broad policy, local administrators in districts and counties require precise data to implement targeted containment measures and avoid the high socio-economic costs of blanket lockdowns. However, forecasting at this resolution is notoriously difficult due to data sparsity and noise. This paper introduces a robust framework that combines signal processing, generalized machine learning strategies, and adaptive loss functions to provide accurate, localized COVID-19 case predictions.

The Challenges of Sub-National Forecasting

Sub-national epidemiological data typically suffers from three primary issues that degrade the performance of standard forecasting models:

  1. Data Unreliability: Small geographic regions often exhibit inconsistent testing and reporting patterns. This results in "noisy" epidemiological curves (epi-curves) characterized by massive daily fluctuations that do not reflect the underlying biological spread of the virus.
  2. Weak Deployability: Models trained on a specific region (e.g., a province in Italy) often fail to generalize when applied to a different context (e.g., a district in Sri Lanka). These models lack exposure to the diverse "types" of outbreaks seen globally.
  3. Data Imbalance: Epi-curves are frequently "zero-inflated." Due to reporting lags or periods between waves, many days show zero cases. Standard neural networks tend to over-optimize for these zeros, leading to a bias that underestimates the onset of new waves.

Methodology

The proposed solution addresses these hurdles through an end-to-end pipeline consisting of three core innovations:

Optimized Smoothing via Low-Pass Filtering (LPF)

Traditional smoothing methods, such as N-day moving averages, introduce a significant time-lag into the data. In a fast-moving pandemic, a three-day delay in detecting a spike can be catastrophic. To mitigate this, the authors utilized a first-order Butterworth Low-Pass Filter. They developed an automated optimizer to determine the ideal "cutoff frequency" for each specific region, effectively stripping away high-frequency noise while preserving the essential signal of the outbreak without the problematic lag of moving averages.

Generalized Training Strategy

To solve the problem of weak deployability, the authors moved away from the "local-only" training paradigm. Instead, they trained a Long-Short-Term-Memory (LSTM) network on a diverse "basis" of geographic regions, including counties in Texas, states in Nigeria, and provinces in Italy and Kazakhstan. By exposing the model to a wide variety of epidemiological dynamics across different climates and population densities, the model becomes robust enough to forecast in completely "unseen" test regions, such as prefectures in Japan or districts in Sri Lanka.

Density-Based Adaptive Loss Function

To combat zero-inflation, the researchers modified the standard Mean Squared Error (MSE) loss function. The new density-based adaptive loss function amplifies the error for rare samples (actual cases) and attenuates it for common samples (zeros). This forces the model to prioritize the actual peaks of the pandemic rather than defaulting to a safe but inaccurate prediction of zero cases.

Key Results and Insights

The framework was validated using a testing set of unseen regions, including Russia, Norway, and Japan. The results demonstrated significant improvements across several metrics:

  • The Power of Smoothing: The optimized LPF technique alone led to a 60% increase in prediction accuracy compared to using raw, unfiltered data.
  • Generalization Success: The strategy of training on a diverse global dataset yielded 30% higher accuracy on average than models trained only on local historical data. This suggests that "diversity beats locality"—a model that has seen various outbreak patterns is better prepared for a new wave in an unseen area than a model with a narrow, local focus.
  • Loss Function Impact: The adaptive loss function improved performance by 40% when dealing with raw, imbalanced datasets, successfully guiding the model through zero-inflated periods.
  • Alert Level Stability: Beyond raw accuracy, the smoothing technique provided more stable "alert levels" (1–4). While raw data caused these levels to fluctuate daily, the optimized smoothing created "high-inertia" levels that more accurately reflect the true disease situation for policy makers.

Conclusion

The study concludes that "Method D"—the combination of LSTM, optimized LPF smoothing, and adaptive loss—is the most effective solution for sub-national forecasting, particularly in regions with inconsistent data. While the adaptive loss function requires further refinement to better distinguish between reporting lags and actual periods of zero cases, the framework represents a major step forward in providing actionable, real-time insights for localized pandemic management. Future work will look toward incorporating external variables, such as holiday schedules and policy changes, to further enhance the model's anticipatory capabilities.

Summary updated

Abstract

COVID-19 continues to cause a significant impact on public health. To minimize this impact, policy makers undertake containment measures that however, when carried out disproportionately to the actual threat, as a result if errorneous threat assessment, cause undesirable long-term socio-economic complications. In addition, macro-level or national level decision making fails to consider the localized sensitivities in small regions. Hence, the need arises for region-wise threat assessments that provide insights on the behaviour of COVID-19 through time, enabled through accurate forecasts. In this study, a forecasting solution is proposed, to predict daily new cases of COVID-19 in regions small enough where containment measures could be locally implemented, by targeting three main shortcomings that exist in literature; the unreliability of existing data caused by inconsistent testing patterns in smaller regions, weak deploy-ability of forecasting models towards predicting cases in previously unseen regions, and model training biases caused by the imbalanced nature of data in COVID-19 epi-curves. Hence, the contributions of this study are three-fold; an optimized smoothing technique to smoothen less deterministic epi-curves based on epidemiological dynamics of that region, a Long-Short-Term-Memory (LSTM) based forecasting model trained using data from select regions to create a representative and diverse training set that maximizes deploy-ability in regions with lack of historical data, and an adaptive loss function whilst training to mitigate the data imbalances seen in epi-curves. The proposed smoothing technique, the generalized training strategy and the adaptive loss function largely increased the overall accuracy of the forecast, which enables efficient containment measures at a more localized micro-level.
BibTeX
@misc{marikkar2021generalized,
  author = {Umar Marikkar and Harshana Weligampola and Rumali Perera and A. S. Jameel Hassan and Suren Sritharan and Gihan Jayatilaka and Roshan Godaliyadda and Vijitha R. Herath and Parakrama Ekanayake and Janaka Ekanayake and Anuruddhika Rathnayake and Samath Dharmaratne},
  title = {{A generalized forecasting solution to enable future insights of COVID-19 at sub-national level resolutions}},
  year = {2021},
  eprint = {2108.09556},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2108.09556},
}
Figure