SocialMP: Learning Social Aware Motion Patterns via Additive Fusion for Pedestrian Trajectory Prediction

Tianci Gao, Yuzhen Zhang, Hang Guo, Pei LvIJCAI 2025 · DOI

Abstract

SocialMP is a novel framework for pedestrian trajectory prediction that integrates interpretable motion patterns with social and environmental context. By employing an iterative "additive fusion" mechanism and human-like visual field rules, the model generates paths that are mathematically accurate, socially plausible, and physically constrained by the environment.

Introduction

Predicting pedestrian trajectories is critical for autonomous systems but remains challenging due to the complex interplay of social norms and physical constraints. Existing deep learning models often act as "black boxes" that may predict physically impossible paths, while model-based approaches using dimensionality reduction (like SVD) often fail to account for social interactions. SocialMP bridges this gap by making motion patterns socially aware and environmentally grounded.

Conceptual overview of SocialMP: (a) Motion Patterns, (b) Environmental Social Interaction, and (c) the resulting SocialMP.

Methodology

The SocialMP framework is built upon three core components designed to mimic human navigation logic:

1. Visual Field-Based Interaction

Unlike models that assume 360-degree awareness, SocialMP implements Visual Field Rules. It categorizes the surrounding area into Strong Attention (front), Weak Attention (sides), and None (behind), mimicking human perception to avoid over-fitting to irrelevant neighbors.

2. Additive Fusion Module

The heart of the system is the Additive Fusion module. It uses an iterative cross-attention mechanism to fuse low-dimensional motion patterns (extracted via SVD) with high-dimensional social and environmental features. This allows the model to learn how specific social pressures modify basic motion patterns—for instance, learning how a "walk straight" pattern must adapt into a "veer left" pattern due to an oncoming pedestrian.

3. Map Loss Function

To ensure physical plausibility, a Map Loss function penalizes trajectories that end in "unwalkable" areas (e.g., buildings or trees) based on scene segmentation maps. This ensures the model respects the physical boundaries of the environment.

Detailed architecture of SocialMP, illustrating feature extraction (SVD and Visual Field Rules), additive fusion via cross-attention, and final trajectory prediction.

Evaluation and Results

The model was evaluated on the ETH-UCY and Stanford Drone Dataset (SDD) benchmarks, which are standard for testing pedestrian interaction.

  • Accuracy: SocialMP achieved a 36.2% improvement in Average Displacement Error (ADE) on ETH-UCY compared to baseline models lacking social/environmental awareness.
  • Plausibility: Qualitative analysis showed the model successfully "steers" pedestrians around obstacles that standard models often ignore, significantly reducing instances of pedestrians walking through buildings.
  • Consistency: The model demonstrated a higher Temporal Correlation Coefficient (TCC), indicating predictions more consistent with actual human movement patterns over time.

Conclusion

SocialMP demonstrates that incorporating human-like perception and iterative fusion of motion patterns significantly enhances trajectory prediction. While the iterative mechanism introduces some computational overhead, the gains in physical and social plausibility mark a significant step forward for autonomous navigation in human-centric environments. Future work will explore 3D data integration and optimization for real-time deployment on low-power robotics.

Summary updated

BibTeX
@inproceedings{gao2025socialmp,
  author = {Tianci Gao and Yuzhen Zhang and Hang Guo and Pei Lv},
  title = {{SocialMP: Learning Social Aware Motion Patterns via Additive Fusion for Pedestrian Trajectory Prediction}},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year = {2025},
  doi = {10.24963/ijcai.2025/11},
}
Figure