If you're just hearing about how AI might soon wipe out humanity, it's important to understand how we got to this point.
It's pretty simple:
- A small group of prescient people realized this would be a problem.
- But most of the people in a position to do something about it didn't hear about it, or didn't take it seriously because it sounded "too sci-fi."
- Even as more and more people began to take it seriously, many people lied or downplayed their concerns for fear of looking silly or harming their careers.
- By the time the world's leading AI scientists were openly voicing their concerns, AI companies were immensely powerful, and they hired lobbyists and PR people to mislead policymakers and the public about the risk.
- As a result, policymakers accepted false solutions, like voluntary safety testing and other forms of self-regulation.
So what's the situation now?
- People are still downplaying their concerns.
- The leading AI companies are telling us again that the next step is more self-regulation. It's still a terrible idea, and we can't keep wasting time on such things.
- Many are suggesting we regulate AI to ensure that it's built safely, but we don't actually know how to build AI safely. The actual solution is to stop building more powerful AI.
- Many people have realized this recently, but we may still need a sustained campaign of political organizing to make sure that we actually get this solution before it's too late.