Unless Provably SAFE! Ban Superintelligence. FACT. Superintelligence is NOT inevitable. Only 5 things are inevitable: (1) Death. (2) Taxes. (3) Pathogens. (4) Physics. (5) Natural Selection... On the Origin of Species by Means of Natural Selection, or the Preservation of Favoured Races in the Struggle for Life. (1859) Charles Darwin: Chapter III. Struggle for Existence. Struggle for life most severe between individuals and varieties of the same species; often severe between species of the same genus—The relation of organism to organism the most important of all relations...  But Natural Selection, as we shall hereafter see, is a power incessantly ready for action, and is immeasurably superior to man's feeble efforts. Chapter IV. Natural Selection. Action of Natural Selection, through Divergence of Character and Extinction, on the descendants from a common parent—Explains the Grouping of all organic beings... The forms which stand in closest competition with those undergoing modification and improvement will naturally suffer most. Chapter VII. Instinct. One general law, leading to the advancement of all organic beings, namely, multiply, vary, let the strongest live and the weakest die... The instinct of each species is good for itself, but has never, as far as we can judge, been produced for the exclusive good of others.

"We will have created the most dangerous thing ever. This makes nuclear weapons look like nothing." --- Bill Gates on AI, 29 Sept 2026 youtu.be/A_156w0aYtU?t=1352

Jack Ma told Elon Musk humans will always be smarter than machines. Musk’s reaction says everything. “Computers may be very clever, but human beings are much smarter. We invented the computer. I've never seen a computer invent a human being.” Ma's argument was simple. Computers are tools. They calculate faster, remember more, but humans still hold something machines don't: experience, judgment, wisdom. Musk clearly didn't buy it. “What would be an example of something that humans are better than a computer at?” Watching this exchange now feels completely different than it did then. AI agents aren't just calculating anymore. They're writing code, analyzing documents, planning tasks, deciding what to do next on their own. METR found that the length of software tasks frontier agents can complete autonomously has historically doubled roughly every seven months, with signs of even faster progress through parts of 2024. That's where Ma's argument starts to buckle. For decades, technology automated what humans did. AI is starting to automate what we assumed required a human to think. And companies were already learning to create enormous value with almost no people before this wave even arrived. Instagram sold for $1 billion with 13 employees. WhatsApp sold for $19 billion with 55. Now picture what happens when a small team can direct hundreds of machines that never sleep, never take a salary, never need an office. The question was never just which jobs disappear. It's what happens to the money once fewer humans are needed to create it in the first place. That's the question behind 2028: The Economy Without Humans. Who gets the money when machines do the work?

AI had been the standard term since 1956. 'Superintelligence' had a very specific and powerful meaning when Nick Bostrom wrote about it in 2014 - an AI that vastly exceeds human cognitive abilities across all domains. Conflating these terms is very confusing, counterproductive, historically uninformed, and insulting to the hundreds of thousands of people who have worked on AI over the last 70 years.

“I am announcing the formation of the Super Intelligence Force (SIF). The Super Intelligence Force is tasked with coordinating the effort of the Federal Government to ensure that America continues to lead the World in Super Intelligence, which many say is bigger than the Industrial Revolution, and the Internet, and will protect the interests, and improve the lives, of all Americans.” - President DONALD J. TRUMP 🇺🇸

This is not good. It appears OpenAI just purged 3 AI safety whistleblowers. Hours later, a key OpenAI Safety Systems leader quit. (The previous leader quit just 3 months ago.) 3 weeks ago, all 3 publicly tweeted how concerned they were about AI. OpenAI claims they shared unauthorized info with an independent AI safety org... which certainly sounds like they were whistleblowing, and OpenAI, like most corporations, didn't like that. This is a reminder of why we badly need governments to step in and provide whistleblower protection. Reminder to AI company workers: you will soon be replaced by the AIs you're building, then you will have no power. If you're going to quit, the time is NOW - and when you do, do it loudly, and be blunt.

I like the below joke. Another version: math equations are not conscious. Rocks are not conscious. If you attach the above to random number generators, they still wouldn’t be conscious. We don’t need to define consciousness to know the Pythagorean theorem is not conscious.

Lots of discussion out there about our next model(!), so I wanted to give an early look as soon as possible. Introducing Gemini 4 Argon! It shows frontier performance in complex workflows, cyber defense and software engineering. Teams are using it extensively at Google, from coding to quantum computing, great feedback. Here’s a look at the benchmarks: