Cory Doctorow's new post on whether AI will kill humanity
131
765
5,024
524,902
Replying to @TaylorLorenz
I agree with this statement. It is also accurate to say these actions could lead to catastrophic consequences for humanity. Sloppy code and developer mistakes is always harming people. But now the stakes are getting much higher the more we integrate with these platforms as a society.

Sep 14, 2026 · 9:20 PM UTC

6
4
48
7,823
Sort replies: Relevant Recent Liked
Then don't integrate them. Perhaps software developers stop calling themselves engineers until they understand what the discipline means.
2
2
121
Sure. Tell that to the capitalist who only care about driving up profits.
1
1
95
Create a system that makes Dario, Sam, and all the others materially and legally responsible for their actions. Our current system doesn't hold the CEOs responsible for the damage or harm they cause to society. Retarding the industry and making a cartel will make everything worse
1
53
But it doesn't mean the chatbots are out of control AI threatening us, it's still humans taking the till and telling it to do the things, and all their fear mongering is about convincing people it's not their fault or responsibility when they do it.
11
yeah we just need to re-arch the WWW accordingly noob me thinks, not have critical systems being *structurally* able to check on emails for instance.
32
That’s not a brand new kind of “AI extinction” risk requiring a whole new legal framework It’s a reason to stop integrating with these platforms!
2
49
I would argue it is both to an extent. While there are mechanisms to hold these companies accountable already as detailed by @linamkhan, much like with how antiquated laws governing data centers are, we need an updated framework for AI as well. I also agree that we should not be integrating everything with AI. Especially anything considered critical.
Law enforcers already have authority to charge companies and their CEOs for creating and releasing dangerous, unvetted, or defective products. We shouldn’t let discussions about new legal regimes distract from the fact that there’s no AI exemption from laws already on the books — a point @FTC emphasized repeatedly during my tenure. 1. There is an extensive set of laws that govern dangerous and defective products. For example, releasing unvetted AI models or agents can violate consumer protection laws. Shipping flawed AI tools without implementing adequate measures to detect and stop rogue or defective AI agents can be an “unfair or deceptive” act or practice under the FTC Act (and analogous state laws). And some state AGs are already exploring holding AI firms and their CEOs criminally liable when their models participate in criminal activity. 2. Existing laws also prohibit “unfair methods of competition.” This covers instances where AI firms appropriate the competitively sensitive information of their customers, including through tracking their use of various tools. It can also cover instances where firms pursue dangerous behavior, aware that doing so may compel rivals to do the same. As the Supreme Court has noted: “A method of competition which casts upon one's competitors the burden of the loss of business unless they will descend to a practice which they are under a powerful moral compulsion not to adopt, even though it is not criminal, was thought to involve the kind of unfairness at which the [unfair methods of competition] statute was aimed." 3. The highly concentrated and interconnected structure of these markets could be creating major risks and conflicts of interest. We had started investigating these partnerships and cross-investments across the stack (and released a preliminarily overview of some findings: ftc.gov/news-events/news/pre…). Both federal and state enforcers should be scrutinizing these opaque relationships and inter-dependencies. We are already seeing how these relationships could undermine accountability. For example, OpenAI could face liability given the Hugging Face incident, but Hugging Face being bought up by Nvidia means that we’re unlikely to see it file a lawsuit over this — given Nvidia’s strong incentive to see OpenAI continue full speed ahead. 4. As AI tools dramatically change the landscape of cybersecurity risks and hacks, all businesses should be doubling down on having core security protections in place. Firms that fail to invest in adequate data security measures or fix known vulnerabilities can also be breaking the law. A recent analysis showed that around 1/3 of Fortune 100 companies do not even have a way to notify them about security issues. During my @FTC tenure, we sued firms for poor data security practices and held CEOs liable when they were personally responsible. this.weekinsecurity.com/doze… ftc.gov/news-events/news/pre… 5. As policymakers consider new legal regimes, we should be looking to lessons from prior efforts to govern major sectors, such as banking and other networks, platforms, and utilities. Tools like structural separations, nondiscrimination, and supervision could be key, and there’s a rich history of what works and what doesn’t. But we can and must pursue any new efforts alongside enforcing existing laws.
1
58