Stop The AI Race is pausing Occupy OpenAI in San Francisco
When Stop The AI Race started the Occupy Anthropic protest on July 20 in San Francisco, we demanded that Dario Amodei urge the US Government for an international AI Treaty that would reduce the risks from AI, e.g. by signing on to
aitreaty.org.
Following the news of the Hugging Face incident, we pivoted to Occupy OpenAI instead, where we've been every single weekday for the past ~8 weeks, asking Sam Altman the same thing.
And since August 18, Occupy OpenAI has spread to OpenAI's New York City offices, led by Matthew Tromp, who has also been coming every single weekday.
The world where we are today is a very different world compared to where we were on July 20.
On July 20 Dario Amodei was not on CBS talking about oversight and governance by "the right combination of democratically-elected governments", let alone mentioning a multi-step plan towards a pause in his latest blogpost.
On July 20 Sam Altman was not talking to Fortune Magazine about Presidents Trump and Xi getting the Nobel Peace Prize together "if they could agree on something that should be easy to agree to", or that "they should be able to agree that no one should be taking a certain level of risk with the development process of this".
On July 20 Sam Altman was not tweeting that "where we will need the help of our government is for international coordination."
What happened was that, over the weekend, Sam Altman and Dario Amodei called on the US Government to take the first steps towards international coordination on pacing the frontier.
But the government has yet to take any step towards it.
Our demand was that they ask. We believe they did.
Which is why we're pausing the Occupation of OpenAI in SF.
Now, what should AI companies be doing when there does not seem to be any way to enforce some pacing between them via the US Government?
Well, as David Sacks said, AI Companies do not need the permission of the government to slow things down.
Anthropic and OpenAI do not need the approval of the USG to stop investing researcher time and compute into the race to self-improving superintelligence that would put all of our lives at risk.
These companies are actively building a technology that would in the best scenario automate all of our jobs and concentrate all of the power in a few governments or companies, and in the worst case lead to human extinction.
And they're doing this without anyone's consent.
Against the wishes of the majority of Americans.
So our fight continues. And if the government won't act now, we need to show there's broad support for it, both from inside the companies and from the public.
So tomorrow at 8:30am ET Stop The AI Race will be joining Irreplaceable in front of OpenAI's New York City office (295 Lafayette St), asking for a complete and immediate freeze of AI development (
partiful.com/e/ldgYm2BkxvVsM…). With Matthew Tromp's occupation of OpenAI's NYC office continuing at the same address (
stoptherace.ai/occupy).
And on Thursday 9am PT, Stop The AI Race will be marching from OpenAI to Anthropic to City Hall, asking AI Company employees to quit their jobs, and join us in calling on the Mayor of San Francisco and the Board of Supervisors to declare an AI Emergency and enforce a full pacing of frontier AI model development in San Francisco.
partiful.com/e/J3T0BiZLyTpGH…
The world is waking up.
The time to act is now.
The world deserves confidence that American companies developing increasingly capable AI will act responsibly, especially as the trajectory of progress has steepened. Every frontier lab must deliver on this, and there is no reason any of us should come to work if we cannot.
We welcome a federal framework that sets consistent safety requirements for frontier AI. But we do not believe we need to wait for an anti-trust exemption or legislation to begin the work of providing this confidence. Consistent rules to manage frontier risk so that we can maximize the benefits are a good idea (and we are excited by ideas like independent auditors).
Years ago, companies like ours developed things like Responsible Scaling Policies and Preparedness Frameworks. Those were good for that moment, and focused primarily on the deployment of completed models, not what happens during their development process.
Today's shift to focusing on safe development and evaluation will need new tools. For example, at OpenAI we now formulate explicit safety cases in advance of frontier reinforcement learning runs we expect to significantly increase capability, in addition to the safety work we have long done in advance of model releases.
We hope that other companies will learn from our approaches and propose their own; we think shared standards for misalignment, monitoring, and safety will lead to better outcomes. We look forward to collaborating with our colleagues across the industry to formulate the best version of these.
When we talk about “pacing”, we do not mean “stopping”. Progress has been rapid and will continue to be. But it should be slower than it otherwise could be; interventions like safety cases and monitoring have significant costs.
Pacing will be well worth this cost; no amount of American competitive pressure should justify recklessness, or let capabilities get ahead of alignment and monitoring.
Where we will need the help of our government is for international coordination. But first we should do what we can ourselves.