Seeing Beyond the Next Step: World-Model-Guided Human-Like Navigation in Multi-Agent Scenes

Seong-Eun Hong, JuYeong Hwang, Jinhyun Kim, Hanyoung Jang, HyeongYeop KangarXiv 2026 · arXiv

TL;DR

This paper introduces a method to give navigation agents "foresight" without the heavy computational cost of running world models at runtime. By using specialized world models as training-time "preference oracles," the authors distill complex reasoning about social dynamics and scene layout into a fast, single-pass policy that is safer and more human-like than traditional reactive baselines.

What Problem Does This Paper Address?

Navigating a crowded sidewalk isn't just about avoiding immediate collisions; it’s about social intuition. A robot might pick a path that is technically "clear" right now but will result in cutting off a group of friends or drifting into a busy road two seconds later.

To avoid these "locally feasible but globally bad" actions, an agent needs foresight—the ability to predict how the environment will evolve. While "world models" can provide these predictions, they are typically too slow to run during real-time navigation. Most existing systems trade this foresight for speed, resulting in reactive behavior that feels robotic and disruptive. The authors tackle this "false dichotomy" between foresight and deployability.

Methods

The authors propose a two-stage training pipeline that moves the heavy lifting of world-model rollouts from inference to training.

  1. Stage 1: Supervised Action Prior. They train a Vision-Language-Action (VLA) model (based on Qwen3-VL-2B) to imitate human trajectories. Instead of continuous control, the model selects from a discrete vocabulary of 100 "motion anchors"—short, behaviorally plausible trajectory snippets.
  2. Stage 2: Preference Distillation. The policy is refined using Group Relative Policy Optimization (GRPO). During this stage, two specialized, "task-aligned" world models act as judges:
  3. State Transition World Model: Predicts the future positions and velocities of nearby pedestrians.
  4. Semantic Transition World Model: Predicts future scene segmentation (e.g., where the sidewalk ends and the road begins), specifically excluding pedestrians to focus on layout.

These world models score candidate actions based on goal progress, smoothness, social risk, and semantic validity. The policy learns to prefer actions that lead to better predicted outcomes. Crucially, at deployment, the world models are discarded. The agent simply performs a single forward pass of the VLA policy, which has now "internalized" the foresight.

Figure 1: Overview of the proposed training pipeline. In Stage 1, we adapt a pretrained VLM into a VLA policy through supervised learning, grounding agent-centric visual observations and structured navigation context to executable motion-skill actions. In Stage 2, we further refine the policy with dual world models, which teaches the agent action–outcome knowledge by comparing plausible candidate actions according to their predicted social, semantic, and goal-directed consequences.

Datasets

The researchers used the standard ETH/UCY pedestrian trajectory datasets, which contain real-world human movement data. They reconstructed these environments in Unity to create high-fidelity 3D simulation scenes for training and evaluation.

  • Training Scenes: ETH_Hotel, Zara01, ETH, and Students003.
  • Generalization Scenes: ETH_Hallway (narrow passages) and ETH_Intersection (crossing flows), which were never seen during training.
Figure 2: Overview of the training and evaluation scenes. We use six scenes in our experiments: Students003, ETH_Hotel, Zara01, ETH, ETH_Hallway, and ETH_Intersection.

Key Insights and Ideas

  • Amortized Foresight: The most significant "aha moment" is that world models don't need to be part of the agent's "brain" at runtime. They can function as a "teacher" during training, allowing the agent to learn the consequences of its actions without having to simulate them every 60 milliseconds.
  • Decomposed World Models: Instead of one monolithic model trying to predict every pixel, the authors split the task. Predicting "who moves where" (social) is fundamentally different from predicting "what the map looks like" (semantic). This decomposition makes the world models more accurate and easier to train.
  • Anchors as Abstractions: Using a discrete set of 100 motion anchors makes the comparison of future outcomes computationally tractable while ensuring the agent's basic movements always look "human-like."

Key Results

  • Safety and Compliance: In the Zara01_Group scenario, the proposed method reduced social region violations (like walking in the road) by an order of magnitude compared to the best baseline, while doubling the goal success rate.
  • Human-Likeness: In a user study, naive observers rated the agent's motion as significantly more natural, smooth, and high-quality than all three major baselines (GBM, CCP, and CEDRL).
  • Efficiency: The distilled policy runs in just 65ms per decision. In contrast, an "online" version that runs the world models at inference time takes 1.2 seconds—far too slow for real-world robotics.

Limitations and Future Work

  • Fixed Vocabulary: The agent is limited to its 100 pre-defined anchors. If a situation requires a very specific maneuver not in the set, the agent can only approximate it.
  • Short Horizon: The world models currently predict only a few seconds into the future. This is enough for immediate social navigation but might miss long-range effects like waiting for a distant car to pass.
  • Sim-to-Real: All evaluations were done in Unity. While the visual and state inputs are realistic, the authors haven't yet validated the policy on a physical robot where sensor noise and actuation delays are factors.
  • Future Directions: The authors suggest learning the motion vocabulary jointly with the policy and exploring hierarchical world models for even longer-term planning.

Summary updated

Abstract

Selecting a next motion in a populated scene is not just a matter of avoiding what is currently in the way: an action can be locally feasible yet drift onto the road instead of the crosswalk, cut into a stream of crossing pedestrians, or bottleneck a narrow passage. These failure modes are invisible from the current state alone, and acting on them requires reasoning about what each candidate action will cause. World models offer exactly this, namely action-conditioned predictions of the future, but rolling them out at every decision step is a cost deployable navigation systems cannot pay, and the field has largely traded foresight for speed. We argue this is a false dichotomy. The natural place for a world model in human-aware navigation is at training time, as a preference oracle that distills foresight into a fast policy, rather than at inference time, as an online planner. We pair a discrete visual action prior with two task-aligned world models, one for nearby social dynamics and one for future scene semantics, that score candidate actions by their predicted consequences and refine the policy through group-relative preference distillation. At deployment, both world models are removed and the policy acts in a single forward pass. Across five held-out evaluation scenarios, this yields navigation that is simultaneously safer, more socially and group-coherent, and more goal-directed than strong reactive and learned baselines, with naive observers rating the resulting motion as more human-like. Taken together, our findings point to a different approach for bringing world-model foresight into deployable agents: not accelerating rollouts, but amortizing them into the policy so that the cost of looking ahead is confined to training. Project page: https://seoneun.github.io/-NeurIPS-2026-Seeing-Beyond-the-Next-Step/
BibTeX
@misc{hong2026seeing,
  author = {Seong-Eun Hong and JuYeong Hwang and Jinhyun Kim and Hanyoung Jang and HyeongYeop Kang},
  title = {{Seeing Beyond the Next Step: World-Model-Guided Human-Like Navigation in Multi-Agent Scenes}},
  year = {2026},
  eprint = {2611.07730},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.07730},
}
Figure