Researchers at Oxford argue that LLMs can't invent anything. It's impossible mathematically. The paper is called "Theory Is All You Need." Teppo Felin and Matthias Holweg take the famous "Attention Is All You Need" title and flip it. Their argument is that AI predicts from the past, while humans reason forward into the future, and those are two different kinds of thinking. Start with the numbers. The authors estimate a large language model trains on roughly 13 trillion tokens. A human reading at 150 words a minute would need about 164,000 years to get through that. A child hears around 20,000 words a day and roughly 36.5 million words in their first five years. It's the same task with wildly different data, and the child still ends up with language that goes far beyond anything they heard. Their point is that the model learns which words tend to follow other words. It becomes a mirror of what people have already written. It doesn't build a theory of how the world works, so it can't step outside its training data. The paper's sharpest thought experiment makes this painful. Imagine an LLM trained in 1633 on every scientific text ever written up to that point. Ask it about Galileo and heliocentrism. Thousands of years of geocentric texts would swamp Galileo's ideas, so the model would tell you he's wrong. It would also rate Tycho Brahe's astrology as more credible than the idea that the Earth moves, because more people had written about astrology. Then there's flight. In 1888 the scientist Joseph LeConte looked at bird data, noted that no bird above 50 pounds could fly, and concluded humans couldn't either. Lord Kelvin, then president of the Royal Society, said he had not the smallest molecule of faith in aerial navigation. The New York Times estimated in 1903 that flight was one to ten million years away. Nine weeks later the Wright brothers flew. The Wrights didn't have better data. They had a theory. They broke flight into three problems, lift, propulsion, and steering, built their own wind tunnels, and generated the data that didn't exist yet. Wilbur wrote in 1900 that he had been "afflicted with the belief that flight is possible to man." Every prediction machine on Earth would have told him no. The authors call this the data belief asymmetry. Every real breakthrough starts with someone believing something the existing data says is wrong. A system trained to minimize surprise can't do that by design. They're not anti AI. They say AI will win at routine, repetitive decisions that extrapolate from the past, which is most decisions. They're just pushing back on the idea that you should replace humans with algorithms whenever possible, which is a direct quote from Kahneman. I use these models every day and this matches what I see. The new stuff comes from the human at the keyboard who decides the data is wrong. LLMs don't think, you do!

TERRA RIFT is out! 🦖💥 Break the world. Own the fight. My @TheSandboxGame Game Jam entry is officially submitted! Destroy the terrain. Open rifts. Create new attack routes. Upgrade your weapons. Ride dinosaurs into battle. This project got slightly out of hand… 😅 and I loved building every bit of it. 🎮 PLAY studio.sandbox.game/play/542… Built with Sandbox Studio + @threejs @TSBCreators

Signal Zero | Ep. 4: Creator Built The Internet. Why Don't They Own It W/ @viewfromhk nitter.net/i/broadcasts/1pJkOXAvW…

Signal Zero | Ep. 4: Creator Built The Internet. Why Don't They Own It W/ @viewfromhk nitter.net/i/broadcasts/1pJkOXAvW…

In BCGW #213, I talk to CEO @viewfromhk about how AI reboots @TheSandboxGame 01:10 How Robby Yung sees the past 12 months in blockchain games. 03:30 How adoption of AI changes game development and distribution. 06:48 One problem for The Sandbox was that its original tools were too simple for pro developers. 08:22 How can The Sandbox employ AI to support professional creators? 10:01 Can you maintain The Sandbox's brand if you move away from its voxel art style? 11:21 Adding AI to The Sandbox has been ongoing for around 3 years. 13:05 In the future, game studios will be much smaller because of AI. 14:50 But will indie devs actually use AI tools? Many seem to hate AI. 17:02 The Sandbox's AI tools are designed to give developers absolute control. 20:30 Using AI, game devs will be more creative and publish across multiple platforms. 23:00 Does this level of AI portability undermine The Sandbox as a platform? 25:10 "We view the metaverse as the world and The Sandbox as a city." 28:14 The goal is not to automate game creation but to give creative people better tools. 29:02 Why The Sandbox is running game jams prior to Studio's planned October launch. 31:43 AI is amazing but only when it does what you ask it to do. You need granular control. 33:15 Sandbox Studio is designed for people who are already using Unity and Unreal.