How Shall I Drive? Interaction Modeling and Motion Planning towards Empathetic and Socially-Graceful Driving

Yi Ren, Steven Elliott, Yiwei Wang, Yezhou Yang, Wenlong Zhang

Abstract

Autonomous vehicles (AVs) often struggle with the social nuances of human driving, leading to "frozen robot" deadlocks or jerky "panic reactions." This paper proposes a game-theoretic framework that incorporates "empathy"—the ability to infer a human driver's intent while considering how the human perceives the AV. By modeling interactions as a recursive reasoning process and introducing a "social gracefulness" loss in motion planning, the system achieves smoother, more efficient negotiations at intersections.

Introduction

Current autonomous vehicles are often "socially clumsy." They may follow traffic laws strictly but fail to navigate unwritten social norms. This manifests in two primary failure modes: the Frozen Robot, where an AV waits indefinitely due to misinterpreting a human's slight movement as aggression, and the Panic Reaction, where sudden maneuvers occur because the AV failed to account for how its own actions influenced the human. The authors argue that these issues stem from a lack of social awareness and empathy.

Methods: Empathetic Interaction Modeling

The framework models driving as a two-player game between the AV ("M") and a Human ("H"). To navigate complex social interactions, the system employs a specific notation to track mutual beliefs and intents.

Notation for interaction modeling, including beliefs about actions and intents for both the AV (M) and Human (H).

Empathetic Intent Inference

The AV attempts to "put itself in the human's shoes" by estimating not just the human's intent (e.g., aggressiveness), but also the human's estimation of the AV's intent. This recursive reasoning loop helps the AV distinguish between a human yielding due to natural passivity versus yielding because they perceive the AV as aggressive. The system assumes agents seek a Nash equilibrium and uses observed actions to back-calculate the most likely intent parameters.

Socially-Aware Motion Planning

The AV uses Model Predictive Control (MPC) with a novel social gracefulness loss. This penalty minimizes the discrepancy between the AV's chosen action and the action the human expects or wants the AV to take, encouraging predictable and "polite" behavior. The objective function balances task completion (moving forward) with safety (avoiding collision) and social grace.

Evaluation and Results

The model was evaluated in simulated intersection scenarios (T-junctions and cross-intersections) involving various combinations of aggressive and non-aggressive intents.

Snapshots of simulated interactions (a-e) demonstrating different negotiation strategies and outcomes over time.

Key results indicate that the socially-aware AV is significantly more "graceful" and efficient than purely proactive or reactive models. Empathetic agents converged to the correct hidden intent of human drivers faster, particularly in conflict scenarios. Furthermore, the model enabled sophisticated "passive-aggressive" signaling—such as nudging forward to indicate intent—which broke deadlocks more effectively than binary stop-go logic. Socially-aware agents avoided panic reactions by aligning their actions with human expectations, leading to smoother negotiations.

Conclusion

While the current model relies on discrete intent spaces and assumes rational behavior, it demonstrates the power of recursive social reasoning in AVs. Future work will focus on scaling these algorithms to continuous domains and multi-vehicle environments to improve real-world urban driving performance.

Summary updated

BibTeX
@inproceedings{ren2019how,
  author = {Yi Ren and Steven Elliott and Yiwei Wang and Yezhou Yang and Wenlong Zhang},
  title = {{How Shall I Drive? Interaction Modeling and Motion Planning towards Empathetic and Socially-Graceful Driving}},
  booktitle = {IEEE International Conference on Robotics and Automation},
  year = {2019},
  doi = {10.1109/icra.2019.8793835},
}
Figure