Optimizing City-Scale Traffic Through Modeling Observations of Vehicle Movements

Fan Yang, Alina Vereshchaka, Bruno Lepri, Wen Dong

Abstract

Urban mobility is a complex, partially observable system where only a fraction of vehicle movements are typically tracked. This paper presents a robust framework for city-scale traffic optimization that moves beyond simple prediction. By modeling traffic as a Partially Observable Discrete-Event Decision Process (PODEDP), the authors demonstrate how suggesting optimal departure times and routes to a small percentage of drivers can significantly reduce congestion and improve arrival punctuality across entire cities.

Introduction

Urban traffic management has traditionally been divided into two separate domains: prediction (forecasting jams) and control (adjusting infrastructure like traffic lights). While modern navigation apps generate vast amounts of "floating car data" (GPS traces), this information is rarely integrated into a closed-loop system that actively influences driver behavior for network-wide benefit.

The primary challenge lies in the nature of traffic itself—it is a partially observable, highly stochastic system. Traditional optimization methods often struggle to scale to the millions of agents in a metropolis, while black-box models like Deep Neural Networks frequently ignore the underlying physics of road networks. This paper proposes a framework that bridges this gap by using sparse data to inform a global optimization strategy.

Methodology

The proposed framework addresses urban congestion by treating the city as a Partially Observable Discrete-Event Decision Process (PODEDP). The system operates in a continuous loop of observation, state estimation, and optimization.

Overview of the closed-loop traffic prediction and control framework showing the interaction between the server and vehicles.

Stochastic Kinetic Modeling and Tracking

Traffic dynamics are modeled using a "stochastic kinetic model" where discrete events, such as a vehicle transitioning between road segments, drive the system. To estimate the global traffic state from noisy observations (e.g., GPS data from only 10% of vehicles), the researchers implemented a Particle Filter (PFSKM). This "observer" reconstructs the belief state of the entire network by leveraging known road topology and queuing dynamics, allowing the model to "fill in the gaps" where data is missing.

Optimization and Control

The "controller" utilizes an Expectation-Maximization (EM) algorithm to generate travel advice. Unlike standard shortest-path algorithms, this framework optimizes for the Charypar-Nagel score, a utility function that balances travel time with the value of performing activities at the destination and penalties for late arrivals. This allows the system to suggest not just the best route, but also the optimal departure time to effectively smooth out peak demand.

Datasets and Evaluation

The framework was benchmarked across five diverse scenarios to prove its versatility:

  • SynthTown: A controlled synthetic scenario for detailed analysis.
  • Berlin: A massive synthetic dataset representing 3 million inhabitants and 24,000 road links.
  • Santiago de Chile: Large-scale modeling of 6 million inhabitants.
  • Dakar: Real-world movement data derived from Call Detail Records (CDR) of 9 million mobile users.
  • NYC Taxicab: Real-world data encompassing 1 million daily trips across 11,000 road links.

Key Results

The PFSKM-based framework consistently outperformed baseline re-planning and state-of-the-art co-evolutionary algorithms in both tracking accuracy and network performance.

Visual comparison between ground truth traffic density and the state reconstructed by the Particle Filter from sparse probe data.
  • Tracking Accuracy: The PFSKM achieved superior reconstruction of city-wide traffic from limited probe data, outperforming standard Deep Learning models (RNNs/DNNs) which lack physics-informed constraints.
  • Efficiency Gains: In the SynthTown scenario, average trip times were reduced from 45.57 to 31.49 minutes.
  • Punctuality: In the Berlin dataset, the on-time arrival ratio improved from 72% to 86%.
  • Scalability: The particle-based approach remained computationally performant on the massive Berlin and Santiago datasets, where Reinforcement Learning models often fail to converge due to high dimensionality.

Discussion and Future Work

The research highlights that physics-informed models can outperform black-box approaches in complex urban environments. By continuously correcting its internal model based on real-time observations, the system remains robust to unexpected surges or delays.

Future work may address the variance inherent in Monte Carlo integration and explore user compliance dynamics, as the system's effectiveness depends on drivers following suggestions. Additionally, the authors suggest using Inverse Reinforcement Learning to personalize utility functions, better reflecting diverse driver preferences beyond simple time minimization.

Summary updated

Abstract

The capability of traffic-information systems to sense the movement of millions of users and offer trip plans through mobile phones has enabled a new way of optimizing city traffic dynamics, turning transportation big data into insights and actions in a closed-loop and evaluating this approach in the real world. Existing research has applied dynamic Bayesian networks and deep neural networks to make traffic predictions from floating car data, utilized dynamic programming and simulation approaches to identify how people normally travel with dynamic traffic assignment for policy research, and introduced Markov decision processes and reinforcement learning to optimally control traffic signals. However, none of these works utilized floating car data to suggest departure times and route choices in order to optimize city traffic dynamics. In this paper, we present a study showing that floating car data can lead to lower average trip time, higher on-time arrival ratio, and higher Charypar-Nagel score compared with how people normally travel. The study is based on optimizing a partially observable discrete-time decision process and is evaluated in one synthesized scenario, one partly synthesized scenario, and three real-world scenarios. This study points to the potential of a “living lab” approach where we learn, predict, and optimize behaviors in the real world.
BibTeX
@article{yang2022optimizing,
  author = {Fan Yang and Alina Vereshchaka and Bruno Lepri and Wen Dong},
  title = {{Optimizing City-Scale Traffic Through Modeling Observations of Vehicle Movements}},
  journal = {IEEE Trans. Intell. Transp. Syst.},
  year = {2022},
  doi = {10.1109/tits.2021.3094758},
}
Figure