TL;DR
ViDecide is a decision-centric framework that transforms video diffusion models from mere "pixel-mimics" into reliable reasoners and planners. By treating video generation as a causal chain of decisions and introducing a novel Corrective Fine-tuning (CFT) method, it boosts the strict success rate of planning tasks from a dismal 23.3% to 83.8%, enabling models to solve complex puzzles and robot manipulation tasks without breaking physical or logical rules.
What Problem Does This Paper Address?
While state-of-the-art video models can generate stunningly realistic visuals, they are notoriously bad at "thinking." When asked to solve a multi-step puzzle like Sokoban or plan a robot's movements, they often hallucinate: blocks might vanish, the "snake" in a game might grow without eating, or a robot arm might simply dissolve through an object.
The authors argue this stems from a fundamental mismatch in how we train these models. Standard video diffusion treats a solution as a fixed-length clip generated all at once. This ignores the causal order of decisions (where step B depends on step A) and focuses the model's training on low-noise levels where it's just refining pixels, rather than high-noise levels where it needs to actually "decide" what happens next.
Methods
ViDecide introduces three core innovations to bridge the gap between "seeing" and "reasoning":
- Causal Diffusion with Adaptive Termination: Instead of generating a whole clip, the model generates one segment at a time, conditioned on the entire history. It learns a visual "End-of-Sequence" (EOS) frame (a red border) to decide when the task is complete, allowing for flexible solution lengths.
- Decision-Focused Training Schedule: The authors observed that reasoning happens at high noise levels (where the future is still "hidden"), while low noise is just for visual cleanup. They shifted the training distribution to spend more time at high noise levels, forcing the model to infer transitions from rules and history.
- Corrective Fine-tuning (CFT): This is a targeted post-training strategy. The model rolls out solutions; if it fails, the system finds the exact "divergence step" where it went wrong. It then takes the original noise that led to failure and trains the model to map that same noise to a successful continuation. This provides explicit, in-distribution supervision for critical errors without the instability of traditional policy-gradient reinforcement learning.
Datasets
The framework was evaluated across three diverse benchmarks:
- VideoRLVR: Abstract rule-based games including Maze, FlowFree, and Sokoban.
- VBVR-MultiStep: Six procedural planning tasks like Tower of Hanoi and Snake Routing.
- RoboTwin-Plan: A newly introduced benchmark for multi-step robot planning using a dual-arm Aloha robot in the RoboTwin 2.0 simulator. It includes tasks like Blocks World and Color Sorting, requiring continuous arm motion and physical consistency.
Key Insights and Ideas
- Reasoning vs. Rendering: There is a clear divide in the diffusion process. Reasoning (deciding the next state) occurs early in denoising (high noise), while rendering (adding textures) occurs late. Standard training schedules over-emphasize the latter, which is why models look good but act "dumb."
- Noise as a Decision Space: CFT treats the initial noise as a "latent decision." By mapping failure-prone noise to successful outcomes, it effectively reshapes the model's decision distribution.
- Causality is King: Moving from bidirectional (all-at-once) to causal (step-by-step) generation is the single biggest factor in reducing rule violations.
Key Results
- Massive Success Rate Gains: On average, ViDecide raised the Strict Success Rate (SSR)—which requires every transition to be valid and the goal to be reached—from 23.3% to 83.8%.
- Outperforming RL: ViDecide significantly outperformed prior diffusion RL methods (like Flow-GRPO), which often struggle with credit assignment in high-dimensional video space.
- Generalization: The models didn't just memorize; they generalized to larger boards (e.g., 9x9 FlowFree) and unseen robot layouts, suggesting they learned the underlying rules of the "world."
- Efficiency: Despite being autoregressive, the models are relatively fast, taking ~4-11 seconds per video with 5 denoising steps.
Limitations and Future Work
- Task-Specific Verifiers: CFT currently relies on automated rule verifiers to identify failures and successes. While these can be built "agentically" using LLMs for games, they are harder to define for open-ended real-world tasks.
- Specialist Models: The current experiments mostly train one specialist model per benchmark. Scaling to a single generalist "reasoning" model across many domains is a natural next step.
- Video-to-Action Gap: While the model plans perfectly in "video space," executing these plans on a real robot requires an inverse dynamics model to translate pixels into motor commands. The authors suggest integrating ViDecide with existing world-action models to close this loop.
Summary updated