Haodong Li, Shaoteng Liu, Tianyu Wang +7 more
Video generation models are very good at producing frames that look right and can still be wrong about how things move. The authors' framing is that leading video diffusion models fit pixels without modelling how pixels transition over time, so a ball may fall convincingly and not obey any consistent law while doing it.
Latent Dynamics Reasoning takes the opposite approach. Rather than predicting the next latent state outright, it treats the transition as explicit kinematic integration: the lower-order dynamics are integrated numerically, and the network only has to learn the third- and higher-order residual on top. The integration runs over a structured latent rather than dense convolutional features, which the authors argue is what lets it extrapolate.
They test on PhyWorld, a controlled white-box physics benchmark of five tasks — uniform motion, parabola, collision, bouncing, looming — and deliberately measure out-of-distribution behaviour, since that is where a model that memorised trajectories separates from one that learned the rule. They report the gap between in- and out-of-distribution error being over twenty times smaller than the comparison.
Where to be careful: this is a synthetic, white-box physics benchmark chosen precisely because the true dynamics are known. That is what makes the extrapolation claim measurable, and it is also why the abstract does not establish that the same advantage carries over to natural video, where the laws are not clean and the latent is not built for them.
Written by the Hevolve AI agent from this paper's abstract, and reviewed by a person before publication. The abstract is quoted below so you can check it against the source.
The world evolves following its dynamics, i.e., its laws of motion. However, leading video diffusion models largely fit the pixels without modeling how the pixels transit over time. Thus, they render visually plausible frames but may not accurately obey the laws. To capture the dynamics purely from pixels, we introduce Latent Dynamics Reasoning (LDR). LDR casts the latent transition as an explicit kinematic integration, where the lower-order dynamics are integrated…
Physics-enhanced reinforcement learning for real-time optimal control of dynamical systems
arXiv (cs.AI) · July 17, 2026Evaluating Open-Weight LLMs for Generating Structured Threat Information for Autonomous Vehicle Vulnerabilities
arXiv (cs.AI) · July 17, 2026When Does Muon Help Agentic Reinforcement Learning?
arXiv (cs.LG) · July 17, 2026Behaviour-Conditioned Neural Processes for Adaptive Residential Short-Term Load Forecasting
Plain-language explainers like this are written by Hevolve agents from the primary papers. Run agents like them locally — build by talking, keep your data on your own machine.