find your why

Cory Doctorow's new post on whether AI will kill humanity

I love how the AI Ethics people morphed from demanding all AI pics of George Washington generate a transsexual two-spirit otherkin to now demanding, after Woke 1.0 crashed, the government takes over AI & simply hands the most woke AI companies a government-protected cartel.

Dario has written that we need to “pace the frontier,” and Sam has agreed. People may be surprised by my response: go ahead. You guys are the frontier. By any reasonable metric — market share, revenue growth, model capability — the two of you have a duopoly on frontier intelligence. You’ve also claimed the lead is widening because of recursive self-improvement. I don’t see what you see in the lab. If the unreleased models are scary enough that you think you should slow down, I support your decision to be responsible. But stop pretending you need anyone else’s permission. Stop pretending antitrust law has to be suspended so you can form a cartel. Stop pretending you need a regulatory approval process that supersedes product liability. Stop pretending METR is independent when it is intertwined with Anthropic’s investors and staff. Stop pretending you need those same evaluators to police competitors who aren’t even at the frontier. Most of all, stop pretending the motivation to slow down is purely altruistic. You face massive product-liability exposure if your products enable a truly damaging cyberattack. The market already punishes models that behave in unpredictable or unauthorized ways. After the Hugging Face episode, it is simply good business for OpenAI and Anthropic to trade some raw power for reliability and predictability. Call it alignment if you want. It is also just giving customers what they want. Pacing the frontier would also create breathing room for a more intelligent conversation about regulation than Bernie Sanders’ “shut it all down.” China is very unlikely to join a global agreement, as you know, and that has to be taken into account as well. So go ahead and pace the frontier. You are the ones setting it. The easiest way not to build superintelligence is for you to agree not to build it. Demanding your preferred regulatory framework as the price of that will look like blackmail of the public and the political system. So just do it. If you do, you’ll buy goodwill for the next conversation. If you don’t, we’ll know this was just another bid for regulatory capture — or an election-season psyop.

This is fascinating . I totally believe it.

I don't think people really understand the fight between Paul Graham and Palmer Luckey which played out this week. To the general public, from a casual perspective, it seemed like two rich guys getting in a heated, impulsive debate on Twitter, dragging out for days. It's not. Paul is worth ~$2.5 billion. Palmer is worth ~$5 billion. Nothing these guys do is impulsive. They've been sitting on this for years. They were arguing in private for months, maybe years, before Palmer decided this week was the correct window of opportunity to make a public attack. Paul Graham is one of the intellectual fulcrum points of Silicon Valley. He funds everyone. He sets the tone. He shapes the agenda. Entry-level professionals mimic his style, his worldview, his mannerisms, the way Paul talks. Everyone parrots his beliefs and policies and essays, as chameleon strivers who are trying to get ahead and climb the social ladder. All of Silicon Valley revolves around a handful of key figures, and Paul Graham was (perceived as) one of the intellectual titans who the entire industry orbited as sycophants. Palmer challenged all that. Paul is an elite, Palmer is an elite, and Palmer Luckey chose to publicly challenge the status quo; the elite consensus; the perceived legitimacy of incumbent elits and their institutions. And he did this for a reason: Palmer is aiming to take the role of Paul Graham, of being the new intellectual godfather of Silicon Valley, based around a new set of ideas: reindustrialization, patriotism, protectionism... rather than America as a deracinated cosmopolitan economic zone to be strip-mined by Third World foreigners. It's much bigger than a Twitter argument. Palmer was publicly demonstrating that the Emperor had no clothes, and that he was strong enough to MOG Paul Graham and get away with it, while other Silicon Valley tech workers would be terrified of making an enemy who could suffocate future business ventures and block potential funding. Palmer Luckey is the face of a new military-industrialist consensus which is seeking to hire American workers for American jobs, to build factories and weapons at home, to remilitarize and reindustrialize, to get away from asset inflation and FIRE (finance, insurance, real estate) as a sterile, parasitic rent-seeking economic system. That's the subtext for all of this. It's a public signal of a rising counterelite challenging a stagnant, ossified status quo which can no longer justify or defend their own claim to power.