Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic

Saeed Rahmani, Shiva Rasouli, Daphne Cornelisse, Eugene Vinitsky, Bart van Arem, Simeon C. CalvertarXiv 2026 · arXiv

TL;DR

This paper provides a comprehensive survey and a unified taxonomy of AI methods used to model and simulate mixed traffic involving both autonomous vehicles (AVs) and human drivers. By bridging traffic engineering and computer science perspectives, it highlights how generative AI, reinforcement learning, and cognitive modeling can transform simple rule-based simulations into realistic, interactive environments necessary for safe AV validation.

What Problem Does This Paper Address?

Before autonomous vehicles can safely dominate public roads, they must undergo rigorous testing. Physical testing is dangerous and expensive, making simulation a critical alternative. However, traditional simulation tools (like SUMO or CARLA) face a major bottleneck: they rely on simplistic, rule-based models (like the Intelligent Driver Model) or static log replays to control surrounding traffic.

These approaches fail to capture the messy, interactive reality of human driving—such as negotiation, distraction, and behavioral heterogeneity. While artificial intelligence has recently exploded with potential solutions (ranging from multi-agent reinforcement learning to generative world models), the literature remains deeply fragmented across different scientific communities. This paper addresses the lack of a unified framework to organize, evaluate, and advance AI-driven mixed-autonomy traffic simulation.

Methods

The authors introduce a structured taxonomy that organizes AI methods along three primary axes:

  1. Single-Agent vs. Multi-Agent Modeling: Single-agent methods focus on learning a policy for an individual vehicle (treating others as part of the environment), while multi-agent methods explicitly model bidirectional interactions and coupled decision-making. These are further split into centralized approaches (e.g., joint diffusion or token-based autoregressive simulators) and decentralized approaches (e.g., multi-agent RL and game-theoretic models).
  2. Agent-Level vs. Environment-Level Simulation: Agent-level methods output specific vehicle trajectories, whereas environment-level methods simulate the entire scene's evolution (such as video-based world models or safety-critical scenario generation frameworks).
  3. Pure Data-Driven AI vs. Cognitive & Physics-Informed Methods: Purely data-driven models are contrasted with hybrid architectures that embed domain knowledge. These include Cumulative Prospect Theory (CPT) for human bounded rationality, cognitive architectures (like ACT-R), risk fields, and physics-informed deep learning (PIDL) to enforce kinematic constraints.
FIGURE 2: Taxonomy of AI methods for modeling mixed-autonomy traffic

Datasets

The survey categorizes and reviews the extensive landscape of datasets and tools used to train these models:

  • Drone-Based Trajectory Datasets: NGSIM, highD, inD, rounD, exiD, INTERACTION, and pNEUMA (a unique dataset capturing traffic via a coordinated swarm of 10 drones).
  • Vehicle-Mounted Sensor Datasets: nuScenes, Argoverse 1 & 2, Waymo Open Motion Dataset (WOMD), and Lyft Level 5.
  • Closed-Loop Evaluation Benchmarks: nuPlan (offering 1,282 hours of data for reactive planning) and CommonRoad.
  • Simulation Tools: High-throughput state-level simulators (GPUDrive, Waymax, Nocturne), sensor-level platforms (CARLA, AWSIM), and traditional traffic-level tools (SUMO, CityFlow).

Key Insights and Ideas

  • The Causality Gap: Most AI models are trained on passive, observational logs. However, simulation inherently requires counterfactual validity—the ability to predict how a human driver will react if an AV deviates from its recorded path. Purely correlational models fail when an AV acts unexpectedly.
  • The Evaluation Crisis: Open-loop metrics like Average Displacement Error (ADE) do not correlate well with closed-loop simulation quality. Models can achieve state-of-the-art log-matching accuracy but still cause collisions when deployed reactively due to "ego status bias" (the dominance of straight-line driving in datasets).
  • The Trilemma of Simulation: Researchers face a constant trade-off between scalability (running millions of steps quickly), behavioral fidelity (realistic human interactions), and controllability (the ability of test engineers to script specific safety-critical scenarios).
  • Cognitive Grounding is Non-Negotiable: Purely data-driven models cannot natively simulate human error modes (like distraction or panic) or extrapolate to novel human-AV interactions. Integrating psychological and physical priors is essential for true realism.

Key Results

As a comprehensive survey paper, the primary results are qualitative syntheses rather than new empirical benchmarks. The authors successfully map out the chronological evolution of the field, showing a clear top-down cascade: agent-level prediction and imitation learning matured first (pre-2016 to 2022), followed by environment-level world models, and most recently, generative AI and foundation models (2023–2024) attempting to unify perception, reasoning, and planning.

Limitations and Future Work

The paper highlights several critical gaps that define the next frontier of traffic simulation:

  • Geographic and Cultural Bias: The vast majority of driving datasets are collected in a few select US/European cities and Singapore. Models trained on these datasets fail to generalize to the dense, mixed-mode traffic environments of South or Southeast Asian cities.
  • Neglecting Co-Adaptation: Current simulators assume static human behavior distributions. In reality, as AV penetration rates increase, human drivers will dynamically adapt their trust, gap acceptance, and following distances.
  • Future Directions: The authors advocate for modular yet differentiable pipelines (rather than massive, uninterpretable monolithic architectures) and the development of standardized, intervention-based closed-loop evaluation protocols to systematically stress-test AV safety.

Summary updated

Abstract

Autonomous vehicles (AVs) are now operating on public roads, which makes their testing and validation more critical than ever. Simulation offers a safe and controlled environment for evaluating AV performance in varied conditions. However, existing simulation tools mainly focus on graphical realism and rely on simple rule-based models and therefore fail to accurately represent the complexity of driving behaviors and interactions. Artificial intelligence (AI) has shown strong potential to address these limitations; however, despite the rapid progress across AI methodologies, a comprehensive survey of their application to mixed autonomy traffic simulation remains lacking. Existing surveys either focus on simulation tools without examining the AI methods behind them, or cover ego-centric decision-making without addressing the broader challenge of modeling surrounding traffic. Moreover, they do not offer a unified taxonomy of AI methods covering individual behavior modeling to full scene simulation. To address these gaps, this survey provides a structured review and synthesis of AI methods for modeling AV and human driving behavior in mixed autonomy traffic simulation. We introduce a taxonomy that organizes methods into three families: agent-level behavior models, environment-level simulation methods, and cognitive and physics-informed methods. The survey analyzes how existing simulation platforms fall short of the needs of mixed autonomy research and outlines directions to narrow this gap. It also provides a chronological overview of AI methods and reviews evaluation protocols and metrics, simulation tools, and datasets. By covering both traffic engineering and computer science perspectives, we aim to bridge the gap between these two communities.
BibTeX
@misc{rahmani2026artificial,
  author = {Saeed Rahmani and Shiva Rasouli and Daphne Cornelisse and Eugene Vinitsky and Bart van Arem and Simeon C. Calvert},
  title = {{Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic}},
  year = {2026},
  eprint = {2604.12857},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2604.12857},
}
Figure