Driving Style Alignment for LLM-powered Driver Agent

Ruoxuan Yang, Xinyue Zhang, Anais Fernandez-Laaksonen, Xin Ding, Jiangtao Gong

TL;DR

Researchers have developed a multi-alignment framework that gives LLM-powered autonomous driving agents distinct "personalities," such as risky or cautious. By combining a new natural language dataset of human driving reasoning with a "Coach Agent" that provides real-time feedback, the system successfully bridges the gap between raw sensor data and nuanced human-like decision-making.

What Problem Does This Paper Address?

While Large Language Models (LLMs) have shown great promise in planning and reasoning for autonomous vehicles (AVs), they often lack a specific "driving style." Most current AV systems are tuned for a generic version of safety that doesn't reflect the diversity of human behavior.

The primary challenge is a data gap: most driving datasets consist of non-linguistic data (like CAN-Bus signals or video) which are difficult for LLMs to "read." To align an agent with a human style, the agent needs to understand the why behind a maneuver, not just the what. This paper addresses the scarcity of high-quality natural language data regarding human driving reasoning and the lack of frameworks to efficiently synchronize LLM agents with these styles.

Methods

The authors propose a Multi-Alignment Framework consisting of three main components:

  1. The Driver Agent: Powered by GPT-4, this agent perceives the environment and maintains a "short-term memory" of recent situations, reasonings, and actions. It uses Chain-of-Thought (CoT) prompting to deduce the best driving action (e.g., "Given the speed of the vehicle ahead... I should match speed by gentle acceleration").
  2. The Coach Agent: This agent acts as a mentor. It reviews the Driver Agent’s recent performance against "Good" human examples and provides feedback. If the Driver Agent makes a mistake or deviates from the intended style, the Coach issues a "Bad" rating and formulates a new driving guideline.
  3. Multi-Alignment Strategy: The framework uses an ablation-tested combination of Demonstrations (D) (few-shot prompts showing how a human drives) and Feedback (F) (guidelines generated by the Coach).

The team also implemented a "slowed-down" simulation clock in the CARLA simulator to account for the latency of GPT-4 API calls, ensuring the agent had enough time to "think" before the car hit an obstacle.

Datasets

The researchers introduced the Driving-Thinking-Dataset, a novel collection of human driving behaviors translated into natural language.

  • Data Collection: 24 drivers performed tasks in a real-world urban environment.
  • Post-Driving Interviews: Crucially, drivers participated in 1.5–2 hour "think-aloud" interviews where they watched their own driving footage and explained their decision-making process.
  • Categorization: Using the Multidimensional Driving Style Inventory (MDSI) and objective CAN-Bus data (speed, throttle %), the researchers distilled these behaviors into two primary styles: Risky and Cautious.

Key Insights and Ideas

  • The "Coach" is Essential: The study found that simply giving an LLM examples (Demonstrations) isn't enough. The Coach Agent is necessary to translate those examples into high-level guidelines that the Driver Agent can follow consistently.
  • Human-Likeness vs. Intelligence: A fascinating psychological finding from their human evaluation was that participants often associated "risky" driving with higher human-likeness, even if they rated it as less "intelligent" or safe. It seems we recognize our own flaws in the agent's aggressive maneuvers.
  • Language as the "Universal Interface": By converting driving into a "Situation-Reasoning-Action" format, the researchers allowed the LLM to use its pre-trained linguistic reasoning to solve physical navigation problems, effectively treating driving as a specialized form of storytelling.

Key Results

The framework was validated in the CARLA simulator and through human surveys involving 270 participants:

  • Safety: Cautious agents achieved the lowest collision rates, especially under the full Multi-Alignment (D+F) condition.
  • Distinctiveness: Risky agents exhibited significantly higher average speeds and throttle percentages compared to Cautious agents.
  • Human Perception: In double-blind tests, humans could clearly distinguish between the styles. The Multi-Alignment method was rated as the most effective at creating a perceptible "Cautious" style that "waits for pedestrians" and "yields to other vehicles."
  • Statistical Significance: The Multi-Alignment approach showed the most significant differences in collision rates and speed metrics between the two styles compared to using demonstrations or feedback alone.

Limitations and Future Work

  • Real-time Latency: Currently, the system relies on GPT-4, which is too slow for real-world, high-speed driving. The simulation had to be slowed down significantly to accommodate the LLM's processing time.
  • Scenario Variety: While the study used urban "edge cases" (like abrupt lane changes by NPCs), the range of driving environments was limited to one simulator map (Town10).
  • Style Nuance: The paper focuses on a binary "Risky vs. Cautious" split. Future work could explore more nuanced personas, such as "Eco-friendly," "Hurry-but-Safe," or "Novice" styles.
  • Cost: Relying on high-end LLM APIs for every driving decision is currently cost-prohibitive for mass-market AVs.

Summary updated

Abstract

Recently, LLM-powered driver agents have demonstrated considerable potential in the field of autonomous driving, showcasing human-like reasoning and decision-making abilities. However, current research on aligning driver agent behaviors with human driving styles remains limited, partly due to the scarcity of high-quality natural language data from human driving behaviors. To address this research gap, we propose a multi-alignment framework designed to align driver agents with human driving styles through demonstrations and feedback. Notably, we construct a natural language dataset of human driver behaviors through naturalistic driving experiments and post-driving interviews, offering high-quality human demonstrations for LLM alignment. The framework’s effectiveness is validated through simulation experiments in the CARLA urban traffic simulator and further corroborated by human evaluations. Our research offers valuable insights into designing driving agents with diverse driving styles. The implementation of the framework 1 and details of the dataset 2 can be found at the link.
BibTeX
@inproceedings{yang2024driving,
  author = {Ruoxuan Yang and Xinyue Zhang and Anais Fernandez-Laaksonen and Xin Ding and Jiangtao Gong},
  title = {{Driving Style Alignment for LLM-powered Driver Agent}},
  booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
  year = {2024},
  url = {https://openreview.net/forum?id=vY6ApRW69B},
}

Loading related content...

Figure