<tt>DecoR</tt> : deconfounding time series with robust regression

Felix Schur, Pio Blieske, Jonas PetersJournal of the Royal Statistical Society Series B (Statistical Methodology) 2025 · DOI

TL;DR

This paper introduces DecoR, a novel method for estimating causal effects in time series data when an unobserved confounder is present. By leveraging the assumption that the confounder is sparse in the frequency domain, DecoR transforms the problem into an adversarial outlier detection task, allowing for robust estimation of causal relationships even with noisy data.

What Problem Does This Paper Address?

Estimating causal relationships is crucial in many scientific fields, but it's often complicated by unobserved confounders – variables that influence both the cause and effect, leading to biased estimates. This is particularly challenging in time series data due to temporal dependencies. While instrumental variable regression can help, instruments aren't always available. This paper tackles the problem of estimating the causal effect between two time series (X and Y) when a third, unobserved time series (U) confounds their relationship. The authors assume that this confounder, U, has a sparse representation in the frequency domain, meaning its influence is concentrated in a few specific frequencies.

Methods

The core innovation is DecoR (Deconfounding by Robust Regression). The authors first transform the time series data into the frequency domain using a discrete cosine transform (or a similar orthonormal basis). In this frequency domain, the confounding effect of U appears as "outliers" in a linear regression model. DecoR then applies robust linear regression techniques to this frequency-domain data to estimate the causal effect (represented by coefficient $\beta$). This approach effectively "outliers" the frequencies associated with the confounder, allowing for a cleaner estimation of the true causal link. They analyze two specific robust regression algorithms, BFS (Brute Force Search) and Torrent, and provide theoretical guarantees for their performance.

Datasets

The paper uses synthetic data generated according to their model (Setting 1) and real-world data from Earth system science. The synthetic data experiments involve generating time series from Ornstein-Uhlenbeck processes and band-limited processes, with varying noise levels and fractions of confounded components. The Earth system science application uses atmospheric circulation (pressure at sea level) as the covariate (X), precipitation as the target (Y), and external forcing (like greenhouse gas concentrations) as the unobserved confounder (U).

Key Insights and Ideas

  • Frequency Domain as a Deconfounding Tool: Transforming time series data into the frequency domain can reveal the structure of confounding in a way that's amenable to outlier detection.
  • Sparsity is Key: The assumption that the confounder is sparse in the frequency domain is crucial. This allows the method to isolate and down-weight the confounded frequencies.
  • Robust Regression for Outlier Detection: Robust regression techniques are naturally suited to handle the "outlier" nature of confounded frequencies in the frequency domain, providing more reliable estimates than standard OLS.
  • DecoR is Robust to Model Misspecification: The simulation experiments suggest that DecoR is resilient even when the underlying assumptions are not perfectly met, which is a significant practical advantage.

Key Results

  • Theoretical Guarantees: The authors provide theoretical guarantees for the consistency of DecoR under specific assumptions about the sparsity of the confounder and the properties of the data.
  • Improved Bounds: They improve existing theoretical bounds for robust regression algorithms (BFS and Torrent) used within DecoR.
  • Empirical Validation: Experiments on synthetic data show that DecoR significantly outperforms OLS, achieving much lower mean absolute estimation errors, especially when noise is present or the confounder is strong.
  • Earth System Science Application: DecoR successfully estimates the causal effect of atmospheric circulation on precipitation, matching the performance of existing methods while requiring fewer assumptions about the confounder's frequency bands.

Limitations and Future Work

  • Assumption of Sparsity: The core assumption is that the confounder is sparse in the frequency domain. If the confounder's influence is spread across many frequencies (dense), DecoR might not perform as well.
  • Data Regularity: The current framework assumes data points are observed at regular intervals. Extending this to irregularly sampled time series is a promising future direction.
  • Longer Time Horizons: Investigating the asymptotics for longer observational time horizons is also suggested.
  • Nonlinear Causal Effects: The current work focuses on linear causal effects. Extending DecoR to handle nonlinear relationships is another avenue for future research.
  • Other Noise Distributions: While the paper considers Gaussian noise, exploring robustness to other noise distributions is mentioned.

Summary updated

Abstract

Abstract Causal inference on time series data is a challenging problem, especially in the presence of unobserved confounders. In this work, we focus on estimating the causal effect of a multivariate time series on a univariate time series when a third (possibly multivariate) time series confounds the relationship but remains unobserved. By assuming spectral sparsity of the confounder, we show how this problem can be framed as an adversarial outlier problem in the frequency domain. We introduce Deconfounding by Robust regression (DecoR), a novel approach that estimates the causal effect using robust linear regression in the frequency domain. We consider two robust regression techniques and provide improved bounds on their estimation errors. Applying these results to DecoR, we prove, under suitable assumptions, upper bounds for the estimation error of DecoR that imply consistency. We demonstrate DecoR’s effectiveness through experiments on both synthetic and real-world data from Earth system science. The simulation experiments furthermore suggest that DecoR is robust with respect to model misspecification.
BibTeX
@article{schur2025tt,
  author = {Felix Schur and Pio Blieske and Jonas Peters},
  title = {{<tt>DecoR</tt> : deconfounding time series with robust regression}},
  journal = {Journal of the Royal Statistical Society Series B (Statistical Methodology)},
  year = {2025},
  doi = {10.1093/jrsssb/qkaf067},
}
Figure