Introduction
Multivariate time series (MTS) data is foundational to modern analytics, from monitoring urban air quality to tracking patient health in intensive care units. However, real-world data collection is frequently plagued by missing values due to sensor malfunctions, transmission failures, or human error. Traditional imputation methods often fail to account for the intricate web of causal relationships and temporal dynamics inherent in these datasets.
A recent study introduces CGCNImp, a novel deep learning framework designed to address these challenges. By integrating Neural Granger Causality with Graph Convolutional Networks (GCNs), CGCNImp explicitly models the "who-affects-whom" structure of data to reconstruct missing values with high fidelity.
The Challenge of Missing Data
Imputing missing values in MTS is difficult because of two primary factors:
- Attribute Correlation: Variables are often physically or logically linked. For instance, wind speed at one location directly influences pollutant concentrations at another.
- Temporal Dependency: Time series data is non-stationary. While past values inform the present, their relevance decays over time—a phenomenon known as temporal decay.
Existing solutions like K-Nearest Neighbors (KNN) or standard Long Short-Term Memory (LSTM) networks often overlook directed causal relationships or struggle with the noise inherent in sensor data.
The CGCNImp Architecture
The CGCNImp model operates through four specialized components:
1. Causal Discovery Module
Instead of assuming static relationships, the model employs Neural Granger Causality to learn a directed adjacency matrix. This causal graph identifies if the history of one variable helps predict the future of another, providing a more physically accurate representation of the system than simple correlation.
2. Correlation Dependency Module
Utilizing the learned causal graph, a Graph Convolutional Network (GCN) processes the data. This allows the model to propagate information across related attributes based on their causal structure, effectively "smoothing" the imputation process.
3. Temporal Dependency Module
This module uses an attention-driven LSTM combined with a time lag matrix. The time lag matrix calculates a decay vector ($\alpha$) that reduces the influence of older observations as the duration of a data gap increases, acknowledging that the system's state becomes more uncertain over time.
4. Total Variation (TV) Reconstruction
To mitigate sensor noise, the model incorporates TV regularization, encouraging imputed values to remain smooth and consistent with neighboring data points.
Experimental Evaluation
The researchers tested CGCNImp on two diverse real-world datasets:
- KDD CUP 2018: A meteorological dataset from Beijing containing 121 variables, including air quality and weather metrics.
- Bird Migration: Trace data for two species (Anser albifrons and Anser fabalis), featuring attributes such as longitude, latitude, speed, and heading.
Results and Discussion
CGCNImp consistently outperformed eight baseline methods, including BRITS, GRUI, and E2E-GAN, across various missing rate scenarios.
- High Accuracy: On the KDD dataset with a 10% missing rate, CGCNImp achieved a Mean Absolute Error (MAE) of 0.062, outperforming the next best model, E2E-GAN (0.074).
- Robustness: The model maintained strong performance even at a 90% missing rate. For the Bird Migration dataset, it achieved an MAE of 0.2014, while traditional methods like BRITS saw errors rise to 0.2896.
- Ablation Studies: Removing the causal graph or the noise reduction module significantly increased error rates, confirming that both spatial causal modeling and temporal smoothing are essential for high-fidelity imputation.
Conclusion
CGCNImp demonstrates that understanding the causal forces driving a system is key to accurately reconstructing its missing parts. By moving beyond simple correlation to directed causal graphs, this framework provides a robust solution for handling high-dimensional, "noisy" time series data in critical real-world applications.
Summary updated