A Physics-Informed Deep Learning Paradigm for Traffic State and Fundamental Diagram Estimation

Rongye Shi, Zhaobin Mo, Kuang Huang, Xuan Di, Qiang Du

TL;DR

This paper introduces PIDL+FDL, a novel deep learning framework that integrates physics-informed neural networks with a learned "fundamental diagram" (FD) to simultaneously estimate traffic states, identify model parameters, and learn the FD itself. This approach significantly improves traffic state estimation accuracy and data efficiency, outperforming existing methods on real-world highway data.

What Problem Does This Paper Address?

Traffic State Estimation (TSE) is crucial for managing traffic flow, but traditional methods face limitations. Model-driven approaches rely on accurate physical models but struggle with complex real-world dynamics and require extensive calibration. Data-driven methods, like machine learning, need vast amounts of data to generalize well, making them data-hungry and potentially lacking interpretability. Hybrid approaches, specifically Physics-Informed Deep Learning (PIDL), aim to combine the strengths of both. However, PIDL can be challenging to train when the underlying physical models involve complex equations. This paper addresses the challenge of efficiently and accurately performing TSE, model parameter identification, and learning the fundamental diagram (FD) – a key relationship between traffic density and flow/speed – especially when the FD itself is unknown or difficult to model explicitly.

Methods

The core innovation is the Physics-Informed Deep Learning with a Fundamental Diagram Learner (PIDL+FDL). This framework extends the existing PIDL by incorporating a Fundamental Diagram Learner (FDL), implemented as a neural network.

Here's a breakdown:

  • Physics-Informed Deep Learning (PIDL): This forms the backbone, using neural networks to approximate traffic states. The "physics-informed" aspect comes from incorporating the governing traffic flow equations (e.g., conservation laws) into the loss function. This acts as a regularization term, guiding the neural network to learn physically consistent solutions.
  • Fundamental Diagram Learner (FDL): Instead of hard-coding a specific FD equation (like Greenshields' or a more complex second-order model), PIDL+FDL uses a separate neural network to learn the FD relationship. This FDL takes traffic density as input and outputs flow or velocity. This makes the framework more flexible and adaptable to unknown or complex FD forms.
  • Simultaneous Learning: The key advantage is that PIDL+FDL learns TSE, model parameters (like diffusion coefficients or relaxation times), and the FD relationship concurrently. The FDL is trained implicitly through the physics-informed loss function, without requiring direct observations of flow or velocity.
  • Regularization: For scenarios with sparse data or potential for abnormal learned FD shapes, a regularization term is introduced to encourage desirable properties (e.g., concavity) in the learned FD.

Datasets

  • Numerical Simulations: The authors generate ground truth data using numerical solutions of the Greenshields-based LWR model and the ARZ model. This allows for controlled experiments to evaluate the method's performance.
  • NGSIM Dataset: This is a widely-used real-world dataset containing vehicle trajectories on a segment of US Highway 101. The data is preprocessed to create spatio-temporal fields of traffic density and velocity, and loop detector data (simulated or actual) is used as observations.

Key Insights and Ideas

  • Learning the Unknown FD is Powerful: Explicitly learning the FD with a neural network (FDL) offers significant advantages over hard-coding it. It allows the model to adapt to complex, real-world FD behaviors that might be missed by simplified analytical forms.
  • Flexibility Trumps Complexity: The paper demonstrates that a simpler, well-trained model (like the first-order LWR with an learned FD) can outperform a more complex model (like the second-order ARZ with a predefined FD) when the latter is harder to train or less adaptable to the data. This highlights the importance of training flexibility in PIDL.
  • Data Efficiency: PIDL+FDL shows remarkable performance even with a small number of loop detectors, underscoring its data efficiency compared to traditional data-driven methods.
  • Unified Framework: The ability to perform TSE, parameter identification, and FD estimation simultaneously within a single framework simplifies the overall modeling process and leverages interdependencies between these tasks.

Key Results

  • Improved Accuracy: PIDL+FDL consistently outperforms baseline methods (including other PIDL variants, EKF, NN, LSTM) in terms of estimation error (Err(p, p) and Err(û, u)) on the NGSIM dataset, especially with a limited number of loop detectors. For example, with 4 loops, the LWR-PIDL+FDL achieved an error of 0.01287 for density estimation.
  • Accurate FD Reconstruction: The learned FD curves from PIDL+FDL closely match the density-flow data points from the NGSIM dataset, even when the flow data itself is not directly observed during training.
  • Effective Parameter Identification: The method accurately estimates model parameters (e.g., diffusion coefficient $\epsilon$ for LWR, relaxation time $\tau$ for ARZ) with high accuracy, even with few observations. For the LWR model, with just three loop detectors, the estimated $\epsilon^*$ was 0.00495, very close to the true value of 0.005.

Limitations and Future Work

  • Hyperparameter Tuning: Like many deep learning methods, PIDL+FDL is sensitive to hyperparameter choices, and tuning them for real-world applications can be complex and scenario-dependent.
  • Noisy Data: The performance of PIDL-based methods can be affected by noisy traffic data, and further investigation is needed on how to robustly handle such noise.
  • Extending Surrogates: The authors suggest exploring the use of ML surrogates for other unobserved traffic quantities (beyond the FD) to further enhance the framework's capabilities.

Summary updated

Abstract

Traffic state estimation (TSE) bifurcates into two main categories, model-driven and data-driven (e.g., machine learning, ML) approaches, while each suffers from either deficient physics or small data. To mitigate these limitations, recent studies introduced hybrid methods, such as physics-informed deep learning (PIDL), which contains both model-driven and data-driven components. This paper contributes an improved paradigm, called physics-informed deep learning with a fundamental diagram learner (PIDL + FDL), which integrates ML terms into the model-driven component to learn a functional form of a fundamental diagram (FD), i.e., a mapping from traffic density to flow or velocity. The proposed PIDL + FDL has the advantages of performing the TSE learning, model parameter identification, and FD estimation simultaneously. This paper focuses on highway TSE with observed data from loop detectors, using traffic density or velocity as traffic variables. We demonstrate the use of PIDL + FDL to solve popular first-order and second-order traffic flow models and reconstruct the FD relation as well as model parameters that are outside the FD term. We then evaluate the PIDL + FDL-based TSE using the Next Generation SIMulation (NGSIM) dataset. The experimental results show the superiority of the PIDL + FDL in terms of improved estimation accuracy and data efficiency over advanced baseline TSE methods, and additionally, the capacity to properly learn the unknown underlying FD relation.
BibTeX
@article{shi2022physics,
  author = {Rongye Shi and Zhaobin Mo and Kuang Huang and Xuan Di and Qiang Du},
  title = {{A Physics-Informed Deep Learning Paradigm for Traffic State and Fundamental Diagram Estimation}},
  journal = {IEEE Trans. Intell. Transp. Syst.},
  year = {2022},
  url = {https://openreview.net/forum?id=byxRMVxIZEL},
}
Figure