SocialTraj: Two-Stage Socially-Aware Trajectory Prediction for Autonomous Driving via Conditional Diffusion Model

Xiao‐Hua Zhou, Zengqi Peng, Jun MaarXiv 2025 · DOI · arXiv

TL;DR

SocialTraj is a two-stage trajectory prediction framework that combines social psychology with generative AI. It first uses Bayesian Inverse Reinforcement Learning to infer a driver's "Social Value Orientation" (SVO)—essentially determining if they are selfish or cooperative—and then uses this social context to guide a Conditional Diffusion Model in generating realistic, multi-modal future paths.

What Problem Does This Paper Address?

Predicting where surrounding vehicles (SVs) will go is a "grand challenge" for autonomous driving, especially in dense, interactive traffic. Most current models struggle with two things: multi-modality and social context.

Multi-modality refers to the fact that a driver might choose several different paths (e.g., braking, swerving, or maintaining speed) in the same situation. Traditional models often produce "mean-centered" forecasts—averaging these possibilities into a single, unrealistic path. Furthermore, these models often ignore the "why" behind a driver's actions. Is the driver aggressive? Are they yielding? Without understanding the underlying social intent and how it interacts with the autonomous vehicle's (EV) own planned path, predictions remain unreliable.

Methods

The authors propose a two-stage pipeline called SocialTraj:

  1. Stage 1: SVO Posterior Estimation: The model uses an attention-based Bayesian Inverse Reinforcement Learning (IRL) module. It looks at a vehicle's recent history and estimates its Social Value Orientation (SVO). SVO is a metric from social psychology that quantifies the trade-off between a driver's self-interest and their desire for collective welfare. This provides a compact, interpretable "personality profile" for every vehicle on the road.
  2. Stage 2: Conditional Diffusion: This estimated SVO is fed into a Conditional Denoising Diffusion Probabilistic Model (DDPM). Unlike standard regression models, diffusion models generate data by iteratively refining noise into a coherent trajectory. SocialTraj conditions this process on three things: the vehicle's history, its inferred SVO, and—crucially—the EV’s own planned future trajectory.

By including the EV's plan, the model explicitly accounts for bidirectional influence: the SV isn't just moving in a vacuum; it is reacting to the autonomous car.

Datasets

The framework was evaluated on two industry-standard highway datasets:

  • NGSIM (US-101 and I-80): Real-world, high-density traffic data from US highways.
  • HighD: High-precision, drone-captured trajectory data from German autobahns.

The authors standardized these datasets to a 5 Hz sampling rate, using 3 seconds of history to predict 5 seconds into the future.

Key Insights and Ideas

  • Psychology as a Prior: Instead of letting a neural network guess intent from raw coordinates, SocialTraj uses SVO as a "behavioral anchor." This makes the model's "reasoning" more interpretable for human engineers.
  • Uncertainty Decomposition: The model distinguishes between aleatoric uncertainty (the inherent randomness of driving) and epistemic uncertainty (our lack of knowledge about a driver's intent).
  • Efficiency through Context: Interestingly, the authors found that providing social context actually makes the diffusion process more efficient. Because the SVO "prunes" unlikely behaviors (e.g., a cooperative driver is unlikely to suddenly cut someone off), the model requires fewer denoising steps to reach a high-quality prediction, reducing inference time by roughly 40%.
  • Bidirectional Interaction: Most models treat surrounding vehicles as obstacles to be avoided. SocialTraj treats them as agents that react to the EV's presence, leading to much more "socially compliant" predictions.

Key Results

SocialTraj significantly outperformed existing baselines like S-GAN and Transformer-based predictors (S-TF):

  • Accuracy: On the NGSIM dataset, it achieved a minADE (Average Displacement Error) of 0.28m, a 20% improvement over the strongest baseline.
  • Stability: It reduced the 5-second prediction error (RMSE) by 14.5% compared to S-TF, showing it handles long-term horizons better.
  • Qualitative Success: Visualization shows the model successfully capturing distinct "modes"—for example, predicting that a vehicle might either accelerate to merge or brake to yield, rather than just predicting a single "average" path that leads to a collision.

Limitations and Future Work

While highly effective on highways, the authors acknowledge a few areas for growth:

  • Scenario Complexity: The current study focuses on highway driving. Future iterations need to tackle more complex urban environments involving intersections, pedestrians, and cyclists.
  • SVO Dynamics: The model assumes SVO remains relatively consistent over short windows. In reality, a driver's "socialness" might shift abruptly during a high-stress maneuver, which could require even more dynamic SVO tracking.
  • Computational Load: While the two-stage approach is faster than vanilla diffusion, real-time deployment on edge hardware remains a hurdle for any iterative generative model.

Summary updated

Abstract

Accurate trajectory prediction of surrounding vehicles (SVs) is crucial for autonomous driving systems to avoid misguided decisions and potential accidents. However, achieving reliable predictions in highly dynamic and complex traffic scenarios remains a significant challenge. One of the key impediments lies in the limited effectiveness of current approaches to capture the multi-modal behaviors of drivers, which leads to predicted trajectories that deviate from actual future motions. To address this issue, we propose SocialTraj, a novel trajectory prediction framework integrating social psychology principles through social value orientation (SVO). By utilizing Bayesian inverse reinforcement learning (IRL) to estimate the SVO of SVs, we obtain the critical social context to infer the future interaction trend. To ensure modal consistency in predicted behaviors, the estimated SVOs of SVs are embedded into a conditional denoising diffusion model that aligns generated trajectories with historical driving styles. Additionally, the planned future trajectory of the ego vehicle (EV) is explicitly incorporated to enhance interaction modeling. Extensive experiments on NGSIM and HighD datasets demonstrate that SocialTraj is capable of adapting to highly dynamic and interactive scenarios while generating socially compliant and behaviorally consistent trajectory predictions, outperforming existing baselines. Ablation studies demonstrate that dynamic SVO estimation and explicit ego-planning components notably improve prediction accuracy and substantially reduce inference time.
BibTeX
@misc{zhou2025socialtraj,
  author = {Xiao‐Hua Zhou and Zengqi Peng and Jun Ma},
  title = {{SocialTraj: Two-Stage Socially-Aware Trajectory Prediction for Autonomous Driving via Conditional Diffusion Model}},
  year = {2025},
  eprint = {2509.17850},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2509.17850},
  howpublished = {arXiv},
}
Figure