Gated Recurrent Graph Convolutional Attention Network for Traffic Flow Prediction

Xiaoyuan Feng, Yue Chen, Hongbo Li, Tian Ma, Yilong RenSustainability 2023 · DOI

TL;DR

This paper introduces GRGCAN, a novel deep learning model that effectively predicts traffic flow by simultaneously capturing complex spatial and temporal dependencies in road networks. By integrating Gated Recurrent Units (GRUs), Graph Convolutional Networks (GCNs), and attention mechanisms, GRGCAN achieves state-of-the-art prediction accuracy while maintaining high computational efficiency.

What Problem Does This Paper Address?

Intelligent Transportation Systems (ITS) rely heavily on accurate traffic flow prediction to manage congestion, reduce travel times, and lower greenhouse gas emissions. However, traffic flow data is inherently complex, exhibiting intricate spatial relationships between road segments and dynamic temporal patterns. Traditional methods often struggle to capture these spatio-temporal correlations effectively, leading to suboptimal predictions. Existing deep learning approaches, while improving, sometimes treat spatial and temporal features in isolation or are limited by their ability to handle non-grid-like road network structures. This paper aims to bridge this gap by proposing a unified model that can simultaneously learn from both spatial road network structures and temporal traffic flow dynamics.

Methods

The proposed Gated Recurrent Graph Convolutional Attention Network (GRGCAN) is built upon three key components, each designed to extract different aspects of the traffic flow data:

  • Temporal Feature Extractor: This component utilizes a Gated Recurrent Unit (GRU) to process the time-series nature of traffic data. Crucially, it incorporates an attention mechanism that adaptively assigns weights to different historical time steps, allowing the model to focus on the most relevant past information for future predictions.
  • Spatial Feature Extractor: This module addresses the spatial dependencies within the road network. It combines a Graph Convolutional Network (GCN) with a novel node attention mechanism. The GCN leverages the graph structure of the road network to capture local spatial features, while the node attention mechanism dynamically assigns importance weights to different sensor nodes, enabling the model to learn which nodes are most influential for predicting the flow at a given location.
  • Adaptive Residual Block: To mitigate the loss of features in deeper network layers, an adaptive residual connection is employed. This block helps to preserve and propagate important spatio-temporal features throughout the network.

The GRGCAN model is designed with three identical components, each processing different temporal granularities (e.g., historical, day-period, week-period). These outputs are then fused using learnable weights, allowing the model to dynamically prioritize information from different temporal scales based on the prediction context.

Datasets

The GRGCAN model was evaluated on two widely used real-world traffic flow datasets:

  • PeMSD4: This dataset contains traffic flow data from 307 sensors in the California Bay Area, collected from January 1, 2018, to February 28, 2018.
  • PeMSD8: This dataset comprises traffic flow data from 170 sensors in San Bernardino, California, collected from July 1, 2016, to August 31, 2016.

Both datasets record traffic data updated every 5 minutes. The data was preprocessed by removing redundant sensors and applying zero-mean normalization. The datasets were split into training, validation, and testing sets in a 6:2:2 ratio.

Key Insights and Ideas

  • Unified Spatio-Temporal Learning: The core insight is that effectively predicting traffic flow requires a model that can simultaneously and dynamically learn from both the spatial structure of the road network and the temporal evolution of traffic. GRGCAN achieves this by integrating GCNs for spatial features and GRUs with attention for temporal features within a cohesive architecture.
  • Importance of Node Attention: The introduction of a node attention mechanism within the spatial feature extractor is highlighted as a significant contributor to performance. This mechanism allows the model to intelligently weigh the influence of neighboring sensors, recognizing that not all sensors are equally relevant for predicting traffic at a specific point.
  • Adaptive Temporal Feature Fusion: The use of multiple GRGCAN components processing data at different temporal granularities (e.g., historical, day-period, week-period) and then fusing their outputs with learnable weights is a clever way to capture diverse temporal patterns. This allows the model to adapt its focus based on the prediction horizon and traffic conditions.
  • Efficiency Matters: The paper emphasizes the importance of computational efficiency for real-time traffic prediction. GRGCAN's streamlined architecture, which avoids module reuse, contributes to its superior training speed compared to many baseline models.

Key Results

The GRGCAN model demonstrated strong performance on both datasets, outperforming several state-of-the-art baseline models.

  • Accuracy: For 1-hour ahead traffic flow prediction, GRGCAN achieved a Mean Absolute Percentage Error (MAPE) as low as 15.97% on PeMSD4 and 12.13% on PeMSD8. These figures represent significant improvements over many baseline methods.
  • Robustness: Visualizations of prediction results showed that GRGCAN is robust to outliers in the data, maintaining accurate predictions even when encountering unusual traffic events.
  • Computational Efficiency: GRGCAN exhibited the best training efficiency among the evaluated models, with an average training time of 19.71 seconds per epoch. This is considerably faster than models that involve repeated GCN operations or complex adjacency matrix constructions.
  • Ablation Studies: Experiments removing individual components (temporal feature extractor, spatial feature extractor, adaptive residual block) showed that each module positively impacts performance, with the spatial feature extractor demonstrating the most significant contribution.

Limitations and Future Work

  • Limitations: While GRGCAN shows excellent performance, the paper acknowledges that its accuracy is still influenced by the inherent complexity and noise in real-world traffic data. The ablation studies also indicate that while all components are beneficial, the spatial feature extractor has the most substantial impact, suggesting potential for further refinement in temporal modeling.
  • Future Work: The authors propose several avenues for future research:
  • Incorporating external factors that influence traffic flow, such as weather conditions, epidemic situations, or driver behavior.
  • Investigating the impact of cyclical events like vacations on traffic patterns.
  • Exploring continual learning techniques to adapt models to evolving traffic dynamics.
  • Extending the model to predict greenhouse gas emissions generated by road traffic, contributing to more environmentally friendly transportation systems.

Summary updated

Abstract

Traffic flow prediction is an important function of intelligent transportation systems. Accurate prediction results facilitate traffic management to issue early congestion warnings so that drivers can avoid congested roads, thus directly reducing the average driving time of vehicles, which means less greenhouse gas emissions. However, traffic flow data has complex spatial and temporal correlations, which makes it challenging to predict traffic flow accurately. A Gated Recurrent Graph Convolutional Attention Network (GRGCAN) for traffic flow prediction is proposed to solve this problem. The model consists of three components with the same structure, each of which contains one temporal feature extractor and one spatial feature extractor. The temporal feature extractor first introduces a gated recurrent unit (GRU) and uses the hidden states of the GRU combined with an attention mechanism to adaptively assign weights to each time step. In the spatial feature extractor, a node attention mechanism is constructed to dynamically assigns weights to each sensor node, and it is fused with the graph convolution operation. In addition, a residual connection is introduced into the network to reduce the loss of features in the deep network. Experimental results of 1-h traffic flow prediction on two real-world datasets (PeMSD4 and PeMSD8) show that the mean absolute percentage error (MAPE) of the GRGCAN model is as low as 15.97% and 12.13%, and the prediction accuracy and computational efficiency are better than the baselines.
BibTeX
@inproceedings{feng2023gated,
  author = {Xiaoyuan Feng and Yue Chen and Hongbo Li and Tian Ma and Yilong Ren},
  title = {{Gated Recurrent Graph Convolutional Attention Network for Traffic Flow Prediction}},
  booktitle = {Sustainability},
  year = {2023},
  doi = {10.3390/su15097696},
}
Figure