Basis retweeted
I'm at #ICML2026 through Sunday with a small cohort from @BasisOrg . Come find us to discuss our projects (world model learning, robot design, formal verification, urban ecology), and our general reasoning systema beneath them
And: event on Thursday evening at 7. Link below
1
1
15
578
We're hiring research scientists in PL and other areas. Join us! basis.ai/join-us/#careers
2
526
Basis retweeted
New preprint on learning abstract world models for robotics planning. Paper + code below. 🤖🌐
Must an agent plan by simulating pixels frame by frame, or can it think in abstractions? Consider planning an international flight: we can reason about buying tickets, changing airplanes, and crossing borders without committing to the color of the airplane or the milliseconds before takeoff. Absent abstraction, planning over long time horizons would be intractable, because every minute detail of the world would need to be simulated.
[1/7]
4
11
27
4,698
Basis retweeted
🚨 MIT and Basis Research just dropped a new way to measure if AI actually understands the world and the results are brutal.
It’s called "WorldTest", and it doesn’t just check how well an AI predicts the next frame or maximizes reward.
It checks whether the model can build an internal model of reality and use it to handle new situations.
They built 'AutumnBench', a suite of 43 interactive worlds and 129 tasks where AIs must:
• Predict hidden parts of the world (masked-frame prediction)
• Plan sequences of actions to reach a goal
• Detect when the environment’s rules suddenly change
Then they tested 517 humans vs. top AI models Claude, Gemini 2.5 Pro, and o3.
Humans crushed every model. Even massive compute scaling barely helped.
The takeaway is wild... current AIs don’t understand environments; they pattern-match inside them.
They don’t explore strategically, revise beliefs, or run experiments like humans do.
WorldTest might be the first benchmark that actually measures understanding, not memorization.
The gap it reveals isn’t small it’s the next grand challenge in AI cognition.
Paper: Benchmarking World-Model Learning (arxiv. org/abs/2510.19788)
56
207
907
110,066
Basis retweeted
like i have been saying since 2019, world models are the next key step.
🔥 MIT just exposed every top AI model and it’s not pretty.
They built a new test called WorldTest to see if AI actually understands the world… and the results are brutal.
It doesn’t just check how well a model predicts the next frame or maximizes reward it tests whether it can build an internal model of reality and use it to handle new situations.
They built AutumnBench 43 interactive worlds, 129 tasks where AIs must:
• Predict hidden parts of the world (masked-frame prediction)
• Plan sequences of actions to reach a goal
• Detect when the environment’s rules suddenly change
Then they tested 517 humans vs. Claude, Gemini 2.5 Pro, and o3.
Humans crushed every model. Even massive compute scaling barely helped.
The takeaway is wild.. today’s AIs don’t understand environments; they just pattern-match inside them.
They don’t explore strategically, revise beliefs, or run experiments like humans do.
WorldTest might be the first benchmark that actually measures understanding, not memorization.
The gap it reveals isn’t small it’s the next grand challenge in AI cognition.
(Comment “Send” I’ll DM you the paper)
10
29
213
32,641
Basis retweeted
"Today’s AIs don’t understand environments; they just pattern-match inside them."
Literally what critics have been saying for years now.
🔥 MIT just exposed every top AI model and it’s not pretty.
They built a new test called WorldTest to see if AI actually understands the world… and the results are brutal.
It doesn’t just check how well a model predicts the next frame or maximizes reward it tests whether it can build an internal model of reality and use it to handle new situations.
They built AutumnBench 43 interactive worlds, 129 tasks where AIs must:
• Predict hidden parts of the world (masked-frame prediction)
• Plan sequences of actions to reach a goal
• Detect when the environment’s rules suddenly change
Then they tested 517 humans vs. Claude, Gemini 2.5 Pro, and o3.
Humans crushed every model. Even massive compute scaling barely helped.
The takeaway is wild.. today’s AIs don’t understand environments; they just pattern-match inside them.
They don’t explore strategically, revise beliefs, or run experiments like humans do.
WorldTest might be the first benchmark that actually measures understanding, not memorization.
The gap it reveals isn’t small it’s the next grand challenge in AI cognition.
(Comment “Send” I’ll DM you the paper)
37
1,011
6,642
151,733
New paper from Basis' Project MARA team and collabs. The ability to learn and use world models is a key aspect of human intelligence, but evaluating this ability remains elusive. In this work we propose WorldTest, a representation-agnostic, behavior-based agent eval framework.
1
11
20
4,203
We'll also be at NeurIPS; come talk to us! Visit our booth or register for our social: luma.com/ivw952te
1
383