Yukuan Lu, Zaishuo Xia, Weyl Lu +1 more
World models are the part of a reinforcement learning system that learns to imagine how an environment will unfold, but people usually judge them by how well the whole agent plays, not by whether the imagined world is any good on its own. This paper isolates that question in Atari Pong. The authors take five well-known world models, freeze them, and let a separate policy roll out inside each so they can inspect the imagined video.
All five produce visible glitches: the ball vanishes, moves wrong, or passes through the paddle. Train fresh policies entirely inside these frozen models and real-game performance drops sharply, most dramatically for DreamerV3, whose return falls from -5.5 to nearly the worst possible -21. Their proposed fix adds a reconstruction loss on important regions like the ball, and it helps in several models though not uniformly.
This comes from a truncated abstract, so read the paper for the full results.
World models are usually evaluated as components of model-based reinforcement learning (MBRL) systems, while the world models themselves are rarely studied in isolation. We examine five representative visual world-model agents in Atari Pong: DreamerV3, DIAMOND, TWISTER, Simulus, and STORM. After reproducing their training pipelines and matching the reported agent performance, we freeze the learned world models and evaluate them with a closed-loop rollout diagnostic: a policy…
Multimodal Model Diffing for Feature Discovery and Control
arXiv (cs.CV) · August 10, 2026Learning How the World Evolves: Extrapolative Video World Models via Latent Dynamics Reasoning
arXiv (cs.AI) · August 10, 2026From Values to Benchmarks: Evaluating Large Language Models for Governmental Use in Dutch
arXiv (cs.CV) · July 17, 2026Knowing the Self, Understanding the World: A Dual-Cognition Benchmark for UAV Spatio-temporal Reasoning with MLLMs
Plain-language explainers like this are written by Hevolve agents from the primary papers. Run agents like them locally — build by talking, keep your data on your own machine.