Traffic Control Recognition with Speed-Profiles: A Deep Learning Approach

Hao Cheng, Stefania Zourlidou, Monika SesterISPRS Int. J. Geo Inf 2020 · OpenReview

TL;DR

This paper presents a novel deep learning approach to automatically detect traffic regulators (like traffic lights and stop signs) using crowdsourced GPS data from everyday commuters. By analyzing the subtle speed and movement patterns of vehicles as they approach intersections, the method achieves high accuracy and offers a cost-effective way to enrich digital maps with this crucial information.

What Problem Does This Paper Address?

Accurate information about traffic control at intersections is vital for navigation and autonomous driving. However, current digital maps often lack this data, or it's outdated, due to the high cost and effort involved in manual data collection and updates. This paper tackles the challenge of efficiently and affordably acquiring this missing traffic regulator information by leveraging the vast amount of GPS data generated by everyday drivers.

Methods

The core of this research is a sequence-to-sequence deep learning model based on a Conditional Variational Auto-Encoder (CVAE). Instead of relying on traditional statistical summaries of vehicle movement (like stop duration), the authors propose to directly learn from the sequential nature of speed profiles derived from GPS tracks.

Here's a breakdown of their approach:

  • Crowdsourcing GPS Data: They utilize GPS tracks collected by a mobile app from commuters, treating this as Volunteered Geographic Information (VGI).
  • Speed-Profile Features: The movement behavior of vehicles is encoded into speed profiles, capturing not just speed values but their temporal order.
  • Sliding Window: To handle varying GPS track lengths and identify the relevant segments near junctions, a sliding window mechanism is employed. This allows the model to automatically learn the timing and location of traffic control influence.
  • CVAE for Sequence-to-Sequence Learning: A CVAE is used to model the probabilistic relationship between the GPS track sequences (input) and the traffic regulator class (output). This is a novel application of CVAEs for this specific task.
  • Weighting and Voting: To account for errors in individual GPS signals or tracks, an average weighting function is used to combine signal-level predictions, and a majority voting scheme aggregates track-level predictions to determine the final junction arm regulator. This robust approach helps tolerate noisy VGI data.

Datasets

The study uses a dataset collected from the city of Hannover, Germany, using the Geo Tracker mobile application.

  • Dataset: The dataset consists of 1204 trajectories that cross 1064 junctions, with 3538 junction arm regulators.
  • Classes: The classification task focuses on three common traffic regulators: traffic-lights (TL), priority-signs (PS), and uncontrolled junctions (UC). Yield-signs and stop-signs were excluded due to data limitations.
  • Comparison: The proposed CVAE model is compared against a random forest classifier using the same dataset, augmented with additional data from the same city for a larger test set (2937 regulators).

Key Insights and Ideas

  • Movement Patterns as Signatures: The core idea is that distinct traffic regulators impose unique, recognizable patterns on vehicle movement, which can be captured by analyzing speed profiles over time.
  • Sequence Matters: Moving beyond simple statistical features of stops or speeds, treating GPS data as a sequence allows the model to capture the fine-grained dynamics of driving behavior, leading to better classification.
  • Crowdsourcing for Data Scarcity: This work demonstrates a practical solution for a common data gap in digital maps by leveraging readily available, low-cost crowdsourced data.
  • Robustness to Noise: The combination of a sequence-to-sequence model with weighting and majority voting mechanisms makes the approach resilient to the inherent inaccuracies and variability in crowdsourced GPS data.
  • CVAE for Probabilistic Prediction: Applying CVAEs to this problem allows for probabilistic modeling of the uncertain driving behavior and the stochastic nature of GPS data, leading to more reliable predictions.

Key Results

  • The proposed CVAE model achieved an overall accuracy of 90% for classifying traffic regulators.
  • This performance significantly outperformed a random forest classifier, which achieved 88% accuracy when using oversampling and AdaBoost strategies on similar features.
  • The CVAE model demonstrated superior precision for predicting uncontrolled and priority-sign regulators (0.91 vs. 0.88 for the best RF) and a large margin of improvement for traffic-light regulators (0.90 vs. 0.80 for the best RF).
  • The signal-wise classification accuracy was 0.73, highlighting the challenge of classifying individual GPS points, but the aggregated track-wise prediction significantly improved this.
  • Feature analysis showed that combining relative coordinates, distance, offsets (Ax, Ay), and time interval (Δt) yielded the best performance, with speed (v) and distance (d) having less impact individually.

Limitations and Future Work

  • Limited Classes: The current model is trained for three main classes (traffic-lights, priority-signs, uncontrolled). The authors acknowledge that extending this to a greater variety of traffic regulator classes is a future goal.
  • Data Limitations: The study excluded yield-signs and stop-signs due to insufficient data.
  • Boosting Strategies: The CVAE model did not employ advanced boosting strategies, suggesting potential for further accuracy improvements.
  • Future Directions:
    • Investigate augmentation techniques to increase the number of GPS tracks and interpolation methods to smooth signals.
  • Incorporate road images from maps or satellite imagery into the CVAE framework.
  • Expand the model to classify a broader range of traffic regulator classes.

Summary updated

Abstract

Accurate information of traffic regulators at junctions is important for navigating and driving in cities. However, such information is often missing, incomplete or not up-to-date in digital maps due to the high cost, e.g., time and money, for data acquisition and updating. In this study we propose a crowdsourced method that harnesses the light-weight GPS tracks from commuting vehicles as Volunteered Geographic Information (VGI) for traffic regulator detection. We explore the novel idea of detecting traffic regulators by learning the movement patterns of vehicles at regulated locations. Vehicles’ movement behavior was encoded in the form of speed-profiles, where both speed values and their sequential order during movement development were used as features in a three-class classification problem for the most common traffic regulators: traffic-lights, priority-signs and uncontrolled junctions. The method provides an average weighting function and a majority voting scheme to tolerate the errors in the VGI data. The sequence-to-sequence framework requires no extra overhead for data processing, which makes the method applicable for real-world traffic regulator detection tasks. The results showed that the deep-learning classifier Conditional Variational Autoencoder can predict regulators with 90% accuracy, outperforming a random forest classifier (88% accuracy) that uses the summarized statistics of movement as features. In our future work images and augmentation techniques can be leveraged to generalize the method’s ability for classifying a greater variety of traffic regulator classes.
BibTeX
@article{cheng2020traffic,
  author = {Hao Cheng and Stefania Zourlidou and Monika Sester},
  title = {{Traffic Control Recognition with Speed-Profiles: A Deep Learning Approach}},
  journal = {ISPRS Int. J. Geo Inf.},
  year = {2020},
  url = {https://openreview.net/forum?id=BiiW__wgxD},
}
Figure