A Deep Learning Framework for Traffic Data Imputation Considering Spatiotemporal Dependencies

Li Jiang, Ting Zhang, Qiruyi Zuo, Chenyu Tian, George P. Chan, Wai Kin Chan

Introduction

Intelligent Transportation Systems (ITS) are fundamental to modern urban management, providing the data necessary for real-time navigation and long-term infrastructure planning. However, the reliability of these systems is often compromised by sensor malfunctions and communication failures, leading to missing data rates as high as 25%. Traditional imputation methods often fail to capture the complex, non-linear spatiotemporal dependencies inherent in traffic networks. This paper introduces STAWnet (Spatio-Temporal Attention WaveNet), a framework designed to reconstruct missing traffic data by leveraging both historical and future context alongside dynamic spatial relationships.

Methodology: The STAWnet Framework

STAWnet adapts advanced architectures from traffic forecasting to the specific requirements of data imputation. Unlike prediction, which is purely autoregressive, imputation benefits from "bidirectional" context—using observations from both before and after a gap to estimate missing values.

Overview of the STAWnet architecture, highlighting the integration of spatiotemporal blocks and node embeddings.

The architecture consists of several innovative components:

  1. Gated Temporal Convolutional Networks (TCN): By utilizing dilated convolutions, STAWnet achieves a vast receptive field without the sequential processing bottlenecks of Recurrent Neural Networks (RNNs). This allows the model to capture long-range temporal patterns essential for understanding daily and weekly traffic cycles.
  2. Dynamic Attention Network (DAN): Rather than assuming static relationships between sensors based on physical distance, the DAN calculates "functional" distance in real-time. It dynamically weights the influence of neighboring sensors at each time step, accounting for shifting traffic conditions like congestion or accidents.
  3. Self-Learning Node Embeddings: The model automatically learns high-dimensional representations (embeddings) for each sensor. These embeddings capture the intrinsic characteristics of specific road segments (e.g., highway vs. residential street) without requiring manual feature engineering.

Experimental Evaluation

The framework was validated using three diverse real-world datasets: the GZ dataset (traffic speed from 214 road segments in Guangzhou), the HZ dataset (passenger flow from 80 metro stations in Hangzhou), and the PeMS dataset (traffic speeds from 325 sensors in the California Bay Area).

Results and Analysis

STAWnet was compared against two established benchmarks: Bayesian Temporal Matrix Factorization (BTMF) and Low-Rank Tensor Completion (LRTC-TNN).

Performance comparison of STAWnet against baseline models across three datasets at 20% and 40% missing data rates.

As shown in the results table, STAWnet demonstrates significant performance gains, particularly on larger datasets. On the PeMS dataset with a 20% missing rate, STAWnet achieved a Mean Absolute Error (MAE) of 3.36, a dramatic improvement over the benchmarks which exceeded 58.0. Similarly, on the GZ dataset, STAWnet consistently maintained the lowest error rates across all metrics (MAE, MAPE, and RMSE) for both 20% and 40% missing data scenarios.

However, the results also highlight a "data hunger" characteristic of deep learning models. In the HZ metro dataset—the smallest of the three—STAWnet was outperformed by the LRTC-TNN method. This suggests that while STAWnet is highly effective for large-scale networks, its performance is contingent on having sufficient data to properly train the node embeddings and attention mechanisms.

Conclusion

STAWnet represents a significant advancement in traffic data imputation by moving beyond static graph assumptions and leveraging bidirectional temporal context. While the model requires substantial data to reach peak performance, its ability to capture dynamic spatiotemporal dependencies makes it a powerful tool for maintaining the data integrity of modern Intelligent Transportation Systems. Future work will focus on improving the model's efficiency on smaller datasets and exploring the interpretability of its learned attention weights.

Summary updated

Abstract

Spatiotemporal (ST) data collected by sensors can be represented as multi-variate time series, which is a sequence of data points listed in an order of time. Despite the vast amount of useful information, the ST data usually suffers from the issue of missing or incomplete data, which also limits its applications. Imputation is one viable solution and often used to prepossess the data for further applications. However, in practice, n practice, spatiotemporal data imputation is quite difficult due to the complexity of spatiotemporal dependencies with dynamic changes in the traffic network and is a crucial prepossessing task for further applications. Existing approaches mostly only capture the temporal dependencies in time series or static spatial dependencies. They fail to directly model the spatiotemporal dependencies, and the representation ability of the models is relatively limited. To better capture the complex spatial-temporal dependencies and impute data, we propose a new ST data imputation model. Temporal convolution and self-attention networks are utilized to capture long-term dependencies and dynamic spatial dependencies, respectively. Furthermore, our model develops a novel self-learning node embeddings to learn the intrinsic attributes of different sensors. An end-to-end framework incorporates these elements. We empirically illustrate the benefit of our proposed framework by comparing other algorithms in real-world data sets.
BibTeX
@inproceedings{jiang2022deep,
  author = {Li Jiang and Ting Zhang and Qiruyi Zuo and Chenyu Tian and George P. Chan and Wai Kin Chan},
  title = {{A Deep Learning Framework for Traffic Data Imputation Considering Spatiotemporal Dependencies}},
  booktitle = {ICITE},
  year = {2022},
  url = {https://openreview.net/forum?id=iHwJrN12VJ},
}
Figure