To put this in more reassuring terms, senior Anthropic staff think the chance AI kills all humans within the next decade is approximately the chance the New York Jets make the playoffs
Jacob is correct here—we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to.