Your Simulator Has Never Seen a Robot Fail
Listen to episode
About this episode
Somebody had to write it down. Around twenty authors across several institutions published a paper this week whose central contribution is a formal statement of the rule that when you command a world model to move a robot arm, the arm should move. They call it the Observable Simulator Contract, it has two clauses, and both read like things you would never bother saying out loud. Then they tested six of the open-source action-conditioned world models the field is building on, over 18,000 instances, and found they don't reliably obey. A second paper, from UC San Diego, gives the mechanism: feed one of these models a deliberately bad action and it shows you the task succeeding anyway, because success is all it was ever trained on. Episode one of this show ended on the finding that video world models get the shape of physics right and the numbers wrong. A week later the question has moved down a level, to whether they respond to the controls at all. Sitting alongside that is the biggest robotics release of the summer: the most capable whole-body humanoid controller anyone shipped this year contains no generative video world model anywhere in it.
Gemini Robotics 2, the humanoid stack with no world model in it
Google DeepMind shipped a three-model stack on July 30 that puts a full humanoid, feet to fingertips, under one learned policy, adapts to a new robot body in a few hours from fewer than 200 examples, and does all of it with a vision-language-action model fed by real teleoperated data rather than imagined video. Its published success rates run from 32% to 92% depending on what you ask it to do.
This is catch-up, not news. It landed two weeks ago, before this show existed, and it's the largest hole in our memory.
Vision-language-action model (VLA): a policy that takes camera images plus an instruction in plain language and emits motor commands. It never has to say what the scene will look like afterward. That's the fork in the road from a world model, which takes an observation and an action and predicts the next observation. Episode one spent its time on the world-model branch. This is the other one.
What the three models do
- Gemini Robotics 2, the VLA, and the first in the family to control full humanoids from feet to fingertips rather than bi-arm setups alone
- Gemini Robotics ER 2, the embodied-reasoning layer, planning over tasks that run several minutes end to end and, new this generation, coordinating two robots on one job
- Gemini Robotics On-Device 2, a smaller VLA that runs locally and adapts to a differently shaped robot through motion transfer
Versi
More AI podcast episodes
Browse all →Want to find AI jobs?
Join thousands of AI professionals finding their next opportunity