Recovered or Memorized? Investigating Dynamical Consistency and Faithfulness in World Model Latents

Jerome Francisco, Kyle Deng, George Flint, Kevin ZhuarXiv 2026 · arXiv

TL;DR

This paper introduces Anchored Recovery Certification (ARC), a new framework to determine if world models are truly learning the underlying physics of an environment or simply memorizing trajectories. While the researchers found that the TD-MPC2 model exhibits "dynamical consistency" (outperforming simple memorization baselines), it fails to achieve "faithfulness," meaning its internal representations do not yet reliably mirror the causal structure of the real world.

What Problem Does This Paper Address?

World models have become a cornerstone of modern Reinforcement Learning (RL), acting as internal simulators that allow agents to "dream" and plan. We know these models work, but we don't fully understand how. Specifically, are they learning the governing equations of their environment (like gravity and damping), or are they just high-dimensional lookup tables that have memorized common paths?

The authors distinguish between two critical properties:

  1. Dynamical Consistency: Does the model produce trajectories that look physically plausible and follow the ground truth?
  2. Dynamical Faithfulness: If we "nudge" the model's internal state, does it respond the same way the real world would respond to a physical nudge?

Closing this gap is essential for building AI that can generalize to new scenarios rather than just repeating what it saw during training.

Methods

The authors developed a procedure called Anchored Recovery Certification (ARC) to measure these properties.

The "Ruler" Approach

To evaluate a model, you need a scale. ARC creates a "ruler" with:

  • The Ceiling: A perfect replication of the ground-truth simulator.
  • The Floor: Baselines that represent "non-learning" behaviors, such as a Memorizer (which just retrieves the nearest neighbor from training data) and Persistence (which predicts that nothing will change).

Measuring Similarity

Instead of using standard Mean Squared Error (which is sensitive to tiny timing offsets), they use the discrete Fréchet distance. Think of this as the "man walking a dog" metric: it measures the minimum leash length needed for a man and a dog to walk their respective paths from start to finish, allowing them to vary their speeds but not move backward. This is converted into a Fréchet Skill Score (FSS), where 1 is perfect and 0 is no better than standing still.

The Observation Lift

To make the task non-trivial, the authors used an "observation lift"—a frozen, random neural network that projects the simple pendulum state into a higher-dimensional space. This forces the world model to untangle the representation before it can learn the dynamics.

Causal Intervention

To test faithfulness, they used PCA on the model's Jacobians to find the "steering subspace." They then compared how the model responded to a latent "nudge" versus how the ground-truth simulator responded to a physical "nudge."

Datasets

The study focused on a controlled Pendulum Swing-up environment using the DeepMind Control Suite (DMControl).

  • Training/Evaluation: Data generated from the pendulum simulator, passed through the "observation lift."
  • Calibration Set: A disjoint set of "off-support" states (extreme velocities) used to fit an affine gauge—a linear map used to align the model's hidden latents with observable physical states.

Key Insights and Ideas

  • Consistency $\neq$ Faithfulness: A model can be very good at predicting the next frame (consistency) without having a latent space that maps logically to physical forces (faithfulness).
  • The "Sweet Spot" Horizon: The model performed best at a 10-step lookahead ($k=10$). At 5 steps, the differences between models were noisy; at 25 steps, the model's performance collapsed, failing to beat even the simplest baselines.
  • Memorization is a High Bar: In many cases, the "Memorizer" baseline (nearest neighbor) performed surprisingly well, highlighting why we need rigorous "floors" to claim a model has actually "learned" anything.

Key Results

  • ARC Sufficiency: At the $k=10$ horizon, the TD-MPC2 model was statistically significant in outperforming the "floor" across six out of seven hyperparameter constraints. This proves the model is doing more than just simple memorization.
  • Faithfulness Failure: Despite being consistent, the models were not faithful. The Relative Error (RelErr) for interventions was almost always greater than 1.0. In plain English: intervening in the model's latent space produced a result that was further from the truth than if you had done nothing at all.
  • Hyperparameter Sensitivity: Narrower latent dimensions (bottlenecks) actually seemed to help the model achieve higher consistency scores, likely by forcing it to compress the dynamics into a more efficient representation.

Limitations and Future Work

  • Decoder-Free Architecture: The study used TD-MPC2, which predicts the next latent state directly without reconstructing an image. The authors suggest that models with decoders (like DreamerV3) might develop more "faithful" latents because they are forced to reconstruct the full observation.
  • Linearity Assumption: The use of an "affine gauge" assumes a linear relationship between latents and observations. If the world model learned the physics in a highly nonlinear way, this test might unfairly penalize it.
  • Single Environment: The results are limited to the pendulum. Future work should explore if these findings hold in more complex environments like Atari or humanoid locomotion.

Summary updated

Abstract

World models develop internal simulators that can learn the structure and dynamics of an environment. It has been demonstrated that their internal representations are both meaningful and causal, but are these representations faithful to the governing dynamics of the environment they are learning? We introduce Anchored Recovery Certification (ARC), a procedure that utilizes a discrete Fréchet distance calculation with ground truth to evaluate dynamical consistency on candidate world models up to an affine gauge. We use the procedure on TD-MPC2 (decoder-free world model) that has learned the pendulum swing on an observation lift under varying hyperparameters at k = 5, 10, 25 steps. The model is then steered within a PCA-derived intervention subspace and compared against a ground-truth simulator using relative error to investigate dynamical faithfulness. ARC sufficiency held for TD-MPC2 most consistently at k = 10, with six of seven constraints statistically significant after Holm-Bonferroni correction, while the relative error between the simulator and the causal latent remained substantial. Further research could be conducted with decoder world models such as DreamerV3 (reconstruction loss) to investigate whether the results differ.
BibTeX
@misc{francisco2026recovered,
  author = {Jerome Francisco and Kyle Deng and George Flint and Kevin Zhu},
  title = {{Recovered or Memorized? Investigating Dynamical Consistency and Faithfulness in World Model Latents}},
  year = {2026},
  eprint = {2611.18807},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.18807},
}
Figure