Closing the Train-Test Gap in World Models for Gradient-Based Planning
The DOI matches its DataCite record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
World models paired with model predictive control (MPC) can be trained offline on large-scale datasets of expert trajectories and enable generalization to a wide range of planning tasks at inference time. Compared to traditional MPC procedures, which rely on slow search algorithms or on iteratively solving optimization problems exactly, gradient-based planning offers a computationally efficient alternative. However, the performance of gradient-based planning has thus far lagged behind that of other approaches. In this paper, we propose improved methods for training world models that enable efficient gradient-based planning. We begin with the observation that although a world model is trained on a next-state prediction objective, it is used at test-time to instead estimate a sequence of actions. The goal of our work is to close this train-test gap. To that end, we propose train-time data synthesis techniques that enable significantly improved gradient-based planning with existing world models. At test time, our approach outperforms or matches the classical gradient-free cross-entropy method (CEM) across a variety of object manipulation and navigation tasks in 10% of the time budget.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dream to Control: Learning Behaviors by Latent Imagination
Hafner, D., Lillicrap, T., Ba, J., & Norouzi, M. (2019) · arXiv · doi:10.48550/arxiv.1912.01603 · Cited by 558
Tassa, Y., Doron, Y., Muldal, A., Erez, T., Li, Y., Casas, D. D. L., Budden, D., Abdolmaleki, A., Merel, J., Lefrancq, A., et al. (2018) · arXiv · doi:10.48550/arxiv.1801.00690 · Cited by 497
Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data
Karl, M., Soelch, M., Bayer, J., & van der Smagt, P. (2016) · arXiv · doi:10.48550/arxiv.1605.06432 · Cited by 232 · cited 1×
“To address this, alternative approaches learn a compact latent representation where dynamics are modeled [29, 23, 50, 30].”
Ha, D., & Schmidhuber, J. (2018) · Zenodo · doi:10.5281/zenodo.1207631 · Cited by 187 · cited 1×
“World models [21], in particular, have emerged as a powerful paradigm.”
Transformers are Sample Efficient World Models
Micheli, V., Alonso, E., & Fleuret, F. (2022) · arXiv · doi:10.48550/arxiv.2209.00588 · Cited by 25 · cited 2×
“We use the dataset of 2000 random trajectories present in [69], with a goal state chosen 25 steps from the starting state. t − 1 ) end for C ( j ) ← ∥ ˆ z H end for return µ I as the final action sequence estimate { ˆ a t } Ht =1”
Revisiting Feature Prediction for Learning Visual Representations from Video
Bardes, A., Garrido, Q., Ponce, J., Chen, X., Rabbat, M., LeCun, Y., Assran, M., & Ballas, N. (2024) · arXiv · doi:10.48550/arxiv.2404.08471 · Cited by 18
Self-citationRobust or Private? Adversarial Training Makes Models More Vulnerable to Privacy Attacks
Mejia, F. A., Gamble, P., Hampel-Arias, Z., Lomnitz, M., Lopatina, N., Tindall, L., & Barrios, M. A. (2019) · arXiv · doi:10.48550/arxiv.1906.06449 · Cited by 13
DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning
Zhou, G., Pan, H., LeCun, Y., & Pinto, L. (2024) · arXiv · doi:10.48550/arxiv.2411.04983 · Cited by 5
Self-citation
Metadata
- Authors
- Agrawal, R., Kalra, N., Parthasarathy, A., LeCun, Y., Bounou, O., Izmailov, P., & Goldblum, M.
- Venue
- arXiv
- Published
- 2025
- arXiv
- 2512.09929
- References
- 8
- Type
- Preprint
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.