Dynamic Spatio-Temporal Graph-Based CNNs for Traffic Flow Prediction

Ken Chen, Fei Chen, Baisheng Lai, Zhongming Jin, Yong Liu, Kai Li, Long Wei, Pengfei Wang, Yandong Tang, Jianqiang Huang, Xian-Sheng Hua

Introduction

Traffic forecasting is a complex spatio-temporal challenge. Accurate predictions require understanding both recent local trends (temporal) and the influence of neighboring sensors (spatial). Traditional Graph Convolutional Networks (GCNs) often rely on static graphs, assuming fixed relationships between locations based on physical distance. However, real-world traffic is dynamic; incidents or weather can alter the effective "connectedness" of a road network. To address this, the Dynamic Spatio-Temporal Graph-Based CNN (DST-GCNN) framework is proposed, which learns to predict the evolving graph structure alongside traffic flow.

Methodology

The DST-GCNN is a two-stream deep learning framework designed to capture the dynamic nature of traffic networks.

Two-Stream Architecture

The model consists of two primary sub-networks:

  1. Graph Prediction Stream: This stream analyzes historical travel time data to predict a future Affinity Matrix, representing the dynamic graph of location influences.
  2. Flow Prediction Stream: Utilizing the predicted graph and historical traffic volumes, this stream forecasts future traffic flow.
Overview of the DST-GCNN architecture featuring the Graph Prediction and Flow Prediction streams.

Spatio-Temporal Convolutional (STC) Layer

To overcome the computational intensity of 3D convolutions or the sequential bottlenecks of Recurrent Neural Networks (RNNs), the authors introduce a factorized STC layer. This layer separates the operation into a spatial graph convolution followed by a 1D temporal convolution, enabling efficient parallelization.

The factorized STC layer performs spatial graph convolution followed by temporal convolution to improve efficiency.

Prediction Strategy

The framework employs a two-step strategy, first predicting intermediate "close future flows" to provide context for the final long-term target forecast. It also integrates auxiliary data, such as weather and calendar information, via one-hot embeddings.

Datasets and Evaluation

The model was validated on three major datasets:

  • METR-LA: Traffic speed data from 207 sensors in Los Angeles.
  • TaxiBJ: In-flow and out-flow volumes in Beijing, including weather data.
  • CD-HW: A new large-scale dataset introduced in this study, featuring 1,692 sensors along highways in Chengdu, China.

Results and Discussion

DST-GCNN consistently outperformed state-of-the-art baselines, including DCRNN and STGCN. On the METR-LA benchmark, it achieved a Mean Absolute Error (MAE) of 3.41 for a 60-minute horizon, a notable improvement over previous methods. Ablation studies confirmed that the Dynamic Graph (DG) component is critical for reducing prediction error. Qualitatively, the model excels at capturing rapid transitions during peak hours, where static-graph models often lag.

Conclusion

By treating the road network graph as a predictable variable rather than a constant, DST-GCNN provides a more accurate and efficient solution for traffic forecasting. Future work may extend this dynamic framework to other domains like pedestrian crowd prediction or skeleton-based action recognition.

Summary updated

Abstract

Forecasting future traffic flows from previous ones is a challenging problem because of their complex and dynamic nature of spatio-temporal structures. Most existing graph-based CNNs attempt to capture the static relations while largely neglecting the dynamics underlying sequential data. In this article, we present dynamic spatio-temporal graph-based CNNs (DST-GCNNs) by learning expressive features to represent spatio-temporal structures and predict future traffic flows from surveillance video data. In particular, DST-GCNN is a two stream network. In the flow prediction stream, we present a novel graph-based spatio-temporal convolutional layer to extract features from a graph representation of traffic flows. Then several such layers are stacked together to predict future flows over time. Meanwhile, the relations between traffic flows in the graph are often time variant as the traffic condition changes over time. To capture the graph dynamics, we use the graph prediction stream to predict the dynamic graph structures, and the predicted structures are fed into the flow prediction stream. Experiments on real datasets demonstrate that the proposed model achieves competitive performances compared with the other state-of-the-art methods.
BibTeX
@article{chen2020dynamic,
  author = {Ken Chen and Fei Chen and Baisheng Lai and Zhongming Jin and Yong Liu and Kai Li and Long Wei and Pengfei Wang and Yandong Tang and Jianqiang Huang and Xian-Sheng Hua},
  title = {{Dynamic Spatio-Temporal Graph-Based CNNs for Traffic Flow Prediction}},
  journal = {IEEE Access},
  year = {2020},
  doi = {10.1109/access.2020.3027375},
}
Figure