Causality-Inspired Safe Residual Correction for Multivariate Time Series

Jianxiang Xie, Yuncheng Hua, Mingyue Cheng, Flora Salim, Hao XuearXiv 2025 · DOI · arXiv

Introduction

In multivariate time series forecasting, modern deep learning architectures such as Transformers and Graph Neural Networks (GNNs) have set new benchmarks for average accuracy. However, these models often harbor a significant weakness: while they perform well on aggregate, they can fail catastrophically on specific variables or time horizons. This lack of reliability in safety-critical applications like energy grid management or traffic control necessitates a more robust approach to model refinement.

This paper introduces CRC (Causality-inspired Safe Residual Correction), a plug-and-play framework designed to refine forecasts while guaranteeing "non-degradation." CRC ensures that model refinements actually improve performance without the risk of introducing new failures, achieving a 95% non-degradation rate across standard benchmarks.

The Corrector’s Dilemma

The authors identify a fundamental challenge in post-hoc model improvement termed the Corrector’s Dilemma. Standard forecasting models often suffer from systematic biases. While "residual correction"—training a secondary model to predict and subtract errors—is a common solution, these correctors are often "greedy." They frequently overfit to irreducible random noise in an attempt to minimize average error. In real-world deployment, a corrector might improve the overall mean squared error (MSE) but cause a massive failure on a specific sensor at a critical hour, making such methods too risky for production environments.

Methodology: The CRC Framework

CRC addresses the Corrector's Dilemma through a "defense-in-depth" architecture that moves away from black-box correction. The framework consists of three primary stages:

  1. Causality-Inspired Encoder: Instead of processing raw error, CRC utilizes an encoder that disentangles "self-dynamics" (a variable's own history) from "cross-node dynamics" (influences from neighboring variables). Inspired by Granger causality, this helps the model distinguish between explainable systematic bias and random noise.
  2. Hybrid Corrector: The correction mechanism is bifurcated into a stable Linear Floor (using Ridge Regression) for simple biases and a lightweight Nonlinear Delta (an MLP) for complex, higher-order patterns.
  3. Four-Fold Safety Firewall: This critical component prevents performance degradation through direction gating, quantile clipping, point-wise selection, and shrink-to-base blending. These mechanisms ensure that corrections are only applied when they are statistically significant and directionally correct.
Figure 2: The complete CRC framework architecture, illustrating the pipeline from data segmentation to the hybrid residual correction and safety gating.

Experimental Evaluation

The researchers evaluated CRC as a plug-in for four major backbone models (TimeXer, TimesNet, PatchTST, and DLinear) across seven standard benchmarks, including ETT (Electricity Transformer Temperature), Weather, Electricity, and Traffic datasets.

Key Results

  • Non-Degradation Rate (NDR): The full CRC model achieved a remarkably high NDR of 95.0%, meaning that in 95% of all (node, horizon) pairs, the corrected model was as good as or better than the baseline.
  • Accuracy Gains: Despite its conservative safety constraints, CRC consistently reduced MSE and MAE across all datasets. Improvements were most pronounced in long-horizon and structurally complex scenarios, such as the Traffic dataset, where systematic biases tend to accumulate.
  • Causal Dynamics: By separating self-influence from neighbor-influence, the model identifies the underlying drivers of error, making the correction robust to distribution shifts.
Figure 5: Heatmaps of causal strength across different sliding windows, demonstrating how the model identifies varying directional influences between nodes over time.

Discussion and Future Work

The core philosophy of CRC is that safety must be engineered into the correction process itself. By being intentionally biased toward the baseline forecast unless evidence for improvement is overwhelming, CRC provides a reliable path for post-hoc model refinement.

While CRC represents a major step forward, the authors note that the current causality-aware encoder relies on a pre-defined adjacency matrix. Future work will explore adaptive safety mechanisms (such as conformal prediction) and online causal discovery to allow the model to learn relationship graphs dynamically during training, potentially reducing the trade-offs between safety and peak accuracy.

Summary updated

Abstract

While modern multivariate forecasters such as Transformers and GNNs achieve strong benchmark performance, they often suffer from systematic errors at specific variables or horizons and, critically, lack guarantees against performance degradation in deployment. Existing post-hoc residual correction methods attempt to fix these errors, but are inherently greedy: although they may improve average accuracy, they can also "help in the wrong way" by overcorrecting reliable predictions and causing local failures in unseen scenarios. To address this critical "safety gap," we propose CRC (Causality-inspired Safe Residual Correction), a plug-and-play framework explicitly designed to ensure non-degradation. CRC follows a divide-and-conquer philosophy: it employs a causality-inspired encoder to expose direction-aware structure by decoupling self- and cross-variable dynamics, and a hybrid corrector to model residual errors. Crucially, the correction process is governed by a strict four-fold safety mechanism that prevents harmful updates. Experiments across multiple datasets and forecasting backbones show that CRC consistently improves accuracy, while an in-depth ablation study confirms that its core safety mechanisms ensure exceptionally high non-degradation rates (NDR), making CRC a correction framework suited for safe and reliable deployment.
BibTeX
@misc{xie2025causality,
  author = {Jianxiang Xie and Yuncheng Hua and Mingyue Cheng and Flora Salim and Hao Xue},
  title = {{Causality-Inspired Safe Residual Correction for Multivariate Time Series}},
  year = {2025},
  eprint = {2512.22428},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2512.22428},
}
Figure