DreamTamer: From Lucky Samples to Reliable Futures in Action Conditioned World Models
Its authors withdrew this paper, so there is no full text to read or summarize.
Lists
Only you see this
Abstract
Action-conditioned world models (ACWMs) predict future observations from visual histories and robot actions, and must faithfully capture the consequences of those actions. However, even with identical observations and actions, pretrained ACWMs can produce substantially different interaction outcomes across random seeds, making faithful prediction inconsistent across samples. To understand this variability, we conduct denoising-stage branching experiments and find that early-stage stochasticity strongly affects prediction fidelity and task-critical interaction dynamics, whereas later-stage stochasticity primarily affects visual details. This finding motivates a reinforcement learning post-training framework that concentrates optimization on denoising transitions with greater influence on prediction fidelity. Specifically, we combine timestep-aware gradient correction with variance-aware timestep sampling to direct learning toward these influential transitions. To further improve reliability across samples, we introduce a lower-bound penalty that targets low-fidelity predictions without directly penalizing favorable deviations. Experiments on Ctrl-World, DreamDojo, and Genie Envisioner demonstrate improvements in average prediction quality, the quality of low-fidelity predictions, and consistency across repeated samples. Together, these results show that our framework makes faithful action-conditioned prediction more reliable across random seeds. We will release all training and evaluation code and model checkpoints to support reproducibility and further research.
BibTeX
@misc{li2027dreamtamer,
author = {Haobo Li and Yanhong Zeng and Zeyu Lou and ZePeng Lin and Haoran Qian and Qin Zhao and Zhihao Xie and Zhipeng Zhang},
title = {{DreamTamer: From Lucky Samples to Reliable Futures in Action Conditioned World Models}},
year = {2027},
url = {https://openreview.net/forum?id=Jz7REGbpbP},
howpublished = {OpenReview},
note = {Submitted to ICLR 2027},
}Loading related content...