H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model

Jinbang Huang, Wenyuan Chen, Zhiyuan Li, Oscar Pang, Xiao Hu, Lingfeng Zhang, Yuanzhao Hu, Zhanguang Zhang, Mark Coates, Tongtong Cao, Xingyue Quan, Yingxue Zhang

TL;DR

Vision-Language-Action (VLA) models often fail on long-horizon robotic tasks due to compounding execution errors and a lack of intermediate guidance. This paper introduces the Hierarchical World Model (H-WM), a framework that pairs a high-level logical world model (an LLM fine-tuned for symbolic reasoning) with a low-level visual world model (predicting latent subgoal features). By providing structured, bilevel guidance, H-WM dramatically improves the success rates of downstream VLA policies on complex, multi-step manipulation tasks.

What Problem Does This Paper Address?

Modern end-to-end VLA models excel at short, reactive robotic behaviors by mapping visual observations and language instructions directly to low-level actions. However, when faced with long-horizon tasks (e.g., an 8-step table-cleaning sequence), their performance plummets. This failure stems from compounding execution errors, ambiguous goal specifications, and a lack of intermediate milestones.

Prior solutions fall short in distinct ways:

  1. LLM Planners decompose tasks into text-based subgoals but struggle to reason about physical constraints, leading to a misalignment between semantics and execution.
  2. Standard Visual World Models generate future video frames to guide the robot, but unconstrained pixel-level generation suffers from compounding prediction errors over long horizons and is computationally expensive.
  3. Classical Task and Motion Planning (TAMP) uses explicit symbolic logic to maintain long-horizon consistency but relies on hand-crafted abstractions that are brittle to real-world perception noise.

The authors bridge these gaps by creating a unified framework that synchronizes high-level symbolic reasoning with low-level perceptual grounding.

Methods

H-WM operates at two distinct temporal resolutions: a low-frequency world model loop for subtask planning, and a high-frequency control loop for VLA action execution.

Overall Framework of H-WM showing the interaction between Logical and Visual World Models

The framework consists of three core components:

  1. Logical World Model ($M_L$): Implemented by fine-tuning a base LLM (Qwen3-4B-Instruct) using Low-Rank Adaptation (LoRA) on chain-of-thought symbolic planning traces. During inference, it serves a dual role: proposing candidate actions/state transitions ($M^{search}_L$) and scoring partial trajectories based on logical consistency ($M^{eval}_L$).
  2. Visual World Model: Instead of generating high-dimensional, noisy raw pixels, this model predicts a compact latent visual subgoal feature ($f^{m+1}_{pred}$). It uses an iterative denoising process conditioned strictly on the current observation, the robot's joint configuration, and the predicted logical state/action from $M_L$.
  3. Guided VLA Policy: Initialized from PaliGemma, the modified VLA architecture uses three specialized transformer modules: an Understanding Expert (encodes current observations and logical actions), a Goal Expert (processes the predicted latent visual subgoal), and an Action Expert (uses cross-attention to synthesize information from both experts and output low-level action chunks).
Detailed overview of the Visual World Model and VLA integration

Datasets

The authors evaluated H-WM on three distinct benchmarks:

  • LIBERO-10: A standard, shorter-horizon robotic manipulation benchmark.
  • RoboCerebra: A large-scale benchmark featuring extra-long-horizon tasks (up to 20 steps).
  • LIBERO-LoHo (Long-Horizon): A new, highly challenging benchmark introduced in this paper. The authors doubled the task horizons of standard LIBERO tasks (creating 5- to 7-step sequences) by increasing the number of manipulated objects and physical dependencies.

Key Insights and Ideas

  • Latent Features > Pixels: A key "aha" moment is that predicting latent visual features provides more effective guidance than generating full images via models like Stable Diffusion. Full pixel generation introduces unnecessary visual details and reconstruction noise that distracts the control policy, whereas latent features offer a clean, compact representation of the goal.
  • Data-Driven Logic Overcomes Brittleness: By learning symbolic transition dynamics directly from data using an LLM, H-WM avoids the rigid, hand-crafted domain definitions (like PDDL) of classical TAMP. This allows the system to remain robust even under incomplete or noisy logical state estimations.
  • Bilevel Constraints Prevent Drifting: The logical world model enforces global task structure and physical constraints, while the visual world model grounds those plans in perceptual space. This dual-layer constraint prevents the VLA policy from omitting steps or executing actions out of order.

Key Results

H-WM was evaluated against several state-of-the-art VLA baselines (including $\pi_0$, $\pi_{0.5}$, and OpenVLA). Performance was measured using Success Rate and Q-Score (the fraction of completed subgoals).

  • LIBERO-LoHo Benchmark: H-WM-guided $\pi_{0.5}$ achieved an average success rate of 64.8%, vastly outperforming the unguided $\pi_{0.5}$ baseline (6.4%). It also beat a variant using Stable Diffusion for visual guidance, which dropped by over 10% in success rate due to pixel noise.
  • RoboCerebra Benchmark: On tasks stretching up to 20 steps, H-WM maintained a high Q-Score (67.1%), proving its resilience against error accumulation over extended sequences.
Quantitative evaluation results across benchmarks and real-robot step-wise success rates
  • Real-World Deployment: The authors successfully deployed H-WM on a physical UR5e robot arm to perform an 8-step table-cleaning and object-arrangement task. The hierarchical guidance allowed the robot to maintain high success rates across later steps where baseline models completely failed.
Real-world 8-step manipulation experiment on a UR5e robot

Limitations and Future Work

Despite its strong performance, H-WM has a few limitations:

  1. System Complexity: Introducing separate logical and visual world models adds multiple training stages and increases overall system complexity and computational overhead.
  2. Dependency on Symbolic State Labels: The framework still relies on the assumption that a task can be meaningfully discretized into a structured, symbolic logical space, requiring explicit logical state annotations during training.

Future work will focus on improving training efficiency, reducing the need for explicit logical supervision, and incorporating additional sensory modalities (like 3D spatial data) to enhance real-world robustness.

Summary updated

Abstract

World models are becoming central to robotic planning and control as they enable prediction of future state transitions. Existing approaches often emphasize video generation or natural-language prediction, which are difficult to ground in robot actions and suffer from compounding errors over long horizons. Classic task and motion planning models world transitions in logical space, enabling robot-executable and robust long-horizon reasoning. However, they typically operate independently of visual perception, preventing synchronized symbolic and visual state prediction. We propose a Hierarchical World Model (H-WM) that jointly predicts logical and visual state transitions within a unified framework. H-WM combines a high-level logical world model with a low-level visual world model, integrating the long-horizon robustness of symbolic reasoning with visual grounding. The hierarchical outputs provide stable intermediate guidance for long-horizon tasks, mitigating error accumulation and enabling robust execution across extended task sequences. Experiments across multiple vision-language-action (VLA) control policies demonstrate the effectiveness and generality of H-WM's guidance.
BibTeX
@inproceedings{huang2026h,
  author = {Jinbang Huang and Wenyuan Chen and Zhiyuan Li and Oscar Pang and Xiao Hu and Lingfeng Zhang and Yuanzhao Hu and Zhanguang Zhang and Mark Coates and Tongtong Cao and Xingyue Quan and Yingxue Zhang},
  title = {{H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model}},
  booktitle = {World Models @ ICLR},
  year = {2026},
  url = {https://openreview.net/forum?id=OQ7cB8ChvF},
}
Figure