Short-Term Traffic Flow Forecasting Method Based on Secondary Decomposition and Conventional Neural Network–Transformer

Qichun Bing, Panpan Zhao, Canzheng Ren, Xueqian Wang, Yiming ZhaoSustainability 2024 · DOI

TL;DR

This paper tackles the challenge of accurately predicting short-term traffic flow by introducing a novel "secondary decomposition" approach. They combine CEEMDAN and VMD to break down complex traffic data into simpler components, which are then fed into a powerful CNN-Transformer model for forecasting. This method significantly improves prediction accuracy compared to existing techniques.

What Problem Does This Paper Address?

Predicting short-term traffic flow is crucial for efficient transportation management, but it's notoriously difficult due to the inherent volatility and randomness of traffic data. Traditional forecasting models often struggle to capture these complex dynamics, leading to inaccurate predictions. The paper aims to overcome this by developing a more robust forecasting framework that can better handle the intricate patterns within traffic data.

Methods

The core of this research lies in a two-stage data decomposition strategy followed by a hybrid deep learning model.

  1. Secondary Decomposition:
    • CEEMDAN (Complete Ensemble Empirical Mode Decomposition with Adaptive Noise): This is the first decomposition step. CEEMDAN breaks down the original traffic flow signal into several "intrinsic mode functions" (IMFs) and a residual. IMFs represent different frequency components of the signal.
  2. VMD (Variational Mode Decomposition): The highest-frequency IMF (IMF1) from CEEMDAN, which often contains the most noise and volatility, is further decomposed using VMD. This secondary decomposition aims to isolate and refine these complex components.
  3. CNN-Transformer Model:
    • CNN (Convolutional Neural Network): For each decomposed IMF component, a CNN is used to extract local spatial features and patterns.
  4. Transformer: The features extracted by the CNN are then fed into a Transformer network. The Transformer excels at capturing long-term temporal dependencies and global relationships within the data, which is vital for forecasting.
  5. Ensemble Forecasting: Finally, the individual forecasts from each IMF component are aggregated to produce the final prediction.

Datasets

The study utilized measured traffic flow data from an urban expressway in Shanghai, China. The data was collected over five consecutive days (August 27-31, 2018) with a 5-minute interval. The paper does not introduce new benchmark datasets.

Key Insights and Ideas

  • The Power of "Secondary Decomposition": The paper strongly advocates for decomposing the most volatile component (IMF1) again. This is a key insight, as simply decomposing the original signal once might not fully address the noise and complexity within the highest-frequency parts.
  • CNN for Local Features, Transformer for Global Context: The hybrid CNN-Transformer architecture is a smart choice. CNNs are great at spotting local patterns (like traffic surges at intersections), while Transformers are essential for understanding how traffic conditions evolve over longer periods (e.g., rush hour patterns).
  • Decomposition Enhances Model Performance: The results clearly show that breaking down the data before feeding it into the forecasting model significantly boosts accuracy. This suggests that complex, non-linear data like traffic flow benefits immensely from being simplified into more manageable components.

Key Results

The proposed CEEMDAN-VMD-CNN-Transformer method demonstrated superior performance in three-step-ahead traffic flow forecasting.

  • Improvement over single decomposition: Compared to a VMD-CNN-Transformer approach, the CEEMDAN-VMD-CNN-Transformer method showed significant reductions in Mean Absolute Percentage Error (MAPE): 25.84%, 23.15%, and 22.38% for three-step-ahead forecasting.
  • Superiority of CNN-Transformer: The CNN-Transformer model itself outperformed a CEEMDAN-VMD-CNN model, with MAPE reductions of 13.58%, 11.88%, and 11.10% for three-step-ahead forecasting.
  • Overall Best Performance: The CEEMDAN-VMD-CNN-Transformer method consistently achieved the lowest forecasting errors (MAE, RMSE, MAPE) across one-step, two-step, and three-step-ahead predictions on both tested datasets (NBDX16(2) and NBXX11(3)). For instance, on the NBDX16(2) dataset, it achieved a 3-step MAPE of 6.73%, significantly lower than other methods.
  • Stability: Boxplots of MAPE indicated that the proposed method had the minimal Inter-Quartile Range (IQR), suggesting greater stability and reliability in its predictions.

Limitations and Future Work

  • Quantifying IMF Complexity: The authors suggest that future work could involve quantifying the complexity of each IMF obtained from the initial decomposition. This could lead to more informed decisions about which components require secondary decomposition.
  • Merging High-Complexity Components: They also propose merging high-complexity components before secondary decomposition, which might further refine the process.
  • Improved Attention Mechanisms: Exploring enhanced attention mechanisms within the Transformer architecture could potentially lead to even better forecasting performance.
  • Parallelization for Speed: To accelerate training and inference, the researchers suggest adopting parallel structures.

Summary updated

Abstract

Because of the random volatility of traffic data, short-term traffic flow forecasting has always been a problem that needs to be further researched. We developed a short-term traffic flow forecasting approach by applying a secondary decomposition strategy and CNN–Transformer model. Firstly, traffic flow data are decomposed by using a Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN) algorithm, and a series of intrinsic mode functions (IMFs) are obtained. Secondly, the IMF1 obtained from the CEEMDAN is further decomposed into some sub-series by using Variational Mode Decomposition (VMD) algorithm. Thirdly, the CNN–Transformer model is established for each IMF separately. The CNN model is employed to extract local spatial features, and then the Transformer model utilizes these features for global modeling and long-term relationship modeling. Finally, we obtain the final results by superimposing the forecasting results of each IMF component. The measured traffic flow dataset of urban expressways was used for experimental verification. The experimental results reveal the following: (1) The forecasting performance achieves remarkable improvement when considering secondary decomposition. Compared with the VMD-CNN–Transformer, the CEEMDAN-VMD-CNN–Transformer method declined by 25.84%, 23.15% and 22.38% in three-step-ahead forecasting in terms of MAPE. (2) It has been proven that our proposed CNN–Transformer model could achieve more outstanding forecasting performance. Compared with the CEEMDAN-VMD-CNN, the CEEMDAN-VMD-CNN–Transformer method declined by 13.58%, 11.88% and 11.10% in three-step-ahead forecasting in terms of MAPE.
BibTeX
@inproceedings{bing2024short,
  author = {Qichun Bing and Panpan Zhao and Canzheng Ren and Xueqian Wang and Yiming Zhao},
  title = {{Short-Term Traffic Flow Forecasting Method Based on Secondary Decomposition and Conventional Neural Network–Transformer}},
  booktitle = {Sustainability},
  year = {2024},
  doi = {10.3390/su16114567},
}
Figure