Toward LLM-Agent-Based Modeling of Transportation Systems: A Conceptual Framework

Tianming Liu, Jianbo Yang, Yafeng Yin

TL;DR

This paper proposes a shift from traditional, rule-based transportation simulations to a framework powered by Large Language Model (LLM) agents. By leveraging the reasoning and "role-playing" capabilities of LLMs, the authors aim to create more behaviorally realistic digital proxies for human travelers that can learn from experience and adapt to new policies without massive, site-specific data calibration.

What Problem Does This Paper Address?

Transportation planning relies heavily on Agent-Based Models (ABMs) to predict how millions of people move through a city. However, current ABMs face a "realism gap." They typically rely on either econometric models (which assume travelers are perfectly rational "Homo Economicus") or rule-based models (which are too rigid to handle complex, real-world nuances).

Furthermore, these traditional models are "data-hungry." Calibrating them for a specific city requires exhaustive local surveys and GPS data. When planners want to test a new technology—like autonomous shuttles or congestion pricing—they often have to rewrite the model's core logic. The authors argue that LLMs can bridge this gap by acting as "behaviorally rich" proxies that understand context, possess memory, and exhibit the "bounded rationality" seen in actual humans.

Methods

The authors introduce a conceptual framework that integrates LLM agents into a dynamic transportation network simulator.

The LLM Agent Architecture

Each agent is more than just a prompt; it is a structured system consisting of:

  • Profile Module: Defines the agent's Identity (age, job, income), Traits (risk preference, environmental consciousness), and Memory (a two-layer system of short-term experiences and long-term reflections).
  • Perception Module: Translates raw environmental data (like traffic speeds or map info) into natural language the LLM can process.
  • Decision-Making Module: Uses prompt engineering and strategic querying to plan activities, tours, and specific trip attributes (mode, route, departure time).
  • Action Module: Converts the LLM’s natural language plans back into structured data (O-D matrices) that a physical traffic simulator (like SUMO or DTALite) can execute.

The Workflow

The system follows a "Need-based" activity generation cycle. Agents don't just "appear" on the road; they generate a day-plan based on household needs (e.g., "Dad needs to work, Kid needs to go to school, we need groceries"). Crucially, the framework includes a Self-correction loop where the agent reviews its own plan for inconsistencies before "driving."

Datasets

The paper is primarily a conceptual framework and literature synthesis, but it validates its ideas using:

  • Literature Synthesis: References to studies using the National Household Travel Survey (NHTS) and Southern California Association of Governments (SCAG) data to show that LLMs can replicate human activity patterns.
  • Demonstrative Prototype: A small-scale synthetic simulation of a "miniature metro area" with four zones (Residential, School, Business, Recreational).
  • Models: The prototype used GPT-4o as the agent core and DTALite as the physical traffic simulator.

Key Insights and Ideas

  • Zero-Shot Generalization: Unlike traditional models that need to be "re-trained" for every city, LLMs come pre-trained on a vast corpus of human behavior. They can often simulate reasonable travel choices in new contexts with minimal task-specific calibration.
  • The Power of Memory: By maintaining a "Travel Memory," agents can experience a "late arrival" on Day 1 and autonomously decide to leave earlier on Day 2—mimicking human learning without explicit "if-then" programming.
  • Persona-Driven Diversity: Small changes in an agent's "Traits" (e.g., "values fresh groceries" vs. "values outdoor exercise") led to significantly different, yet logical, emergent behaviors in the simulation.
  • Hybrid Modeling as a Bridge: The authors suggest a "near-term strategy" where LLMs handle unstructured, complex decisions (like scheduling a day), while traditional mathematical models handle structured, high-scale tasks (like route assignment).

Key Results

The proof-of-concept simulation with 10 agents over 21 days yielded promising results:

  • High Formatting Reliability: The agents successfully converted natural language plans into simulator-ready data with a 99.6% accuracy rate (only 4 trips omitted out of 1,092).
  • Emergent Equilibrium: Agents initially arrived late for work/school due to simulated congestion. Within a few "days," they autonomously adjusted their departure times, converging toward a stable arrival pattern near their 8:00 AM targets.
  • Contextual Activity Generation: Agents with specific traits (like a preference for fresh groceries) successfully increased the frequency of maintenance activities (grocery runs) compared to the baseline agents.

Limitations and Future Work

  • Scalability: Simulating a city of millions using GPT-4o is currently cost-prohibitive and slow due to inference latency.
  • Stochasticity vs. Determinism: LLMs tend to predict the "most probable" next word, which can lead to repetitive, robotic behavior. Real humans are more random. Future work needs to better model this inherent behavioral "noise."
  • Inherent Bias: LLMs may carry biases from their training data that misrepresent certain demographic groups' travel behaviors.
  • Validation: While the agents look like they behave like humans, large-scale benchmarking against empirical, real-world trajectory data is still required to prove their predictive accuracy.

Summary updated

Abstract

In transportation system demand modeling and simulation, agent-based models and microsimulations are current state-of-the-art approaches. However, existing agent-based models still have some limitations on behavioral realism and resource demand that limit their applicability. In this study, leveraging the emerging technology of large language models (LLMs) and LLM-based agents, we propose a general LLM-agent-based modeling framework for transportation systems. We argue that LLM agents not only possess the essential capabilities to function as agents but also offer promising solutions to overcome some limitations of existing agent-based models. Our conceptual framework design closely replicates the decision-making and interaction processes and traits of human travelers within transportation networks, and we demonstrate that the proposed systems can meet critical behavioral criteria for decision-making and learning behaviors using related studies and a demonstrative example of LLM agents' learning and adjustment in the bottleneck setting. Although further refinement of the LLM-agent-based modeling framework is necessary, we believe that this approach has the potential to improve transportation system modeling and simulation.
BibTeX
@misc{liu2024toward,
  author = {Tianming Liu and Jianbo Yang and Yafeng Yin},
  title = {{Toward LLM-Agent-Based Modeling of Transportation Systems: A Conceptual Framework}},
  year = {2024},
  eprint = {2412.06681},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2412.06681},
}
Figure