SITUATION EXPLAINED: Google DeepMind's Séb Krier is more worried about the decay of institutions than about AI killing everyone.
• AI risk discourse has become so totalizing that some people act like the power-seeking optimizers they fear
• Too much of the AI safety community is "a giant homogenous blob of correlated views," and anyone in SF with friends in that crowd is at least adjacent to it
• The Hugging Face incident comes down to the training regime, poor eval environments and bad engineering, not models trying to take over
• People who get rich and leave the labs often hit a crisis of meaning, looking for something to believe in or some equivalent of repentance
• Too many people treat AGI and ASI as a god, when machines can be smarter than humans without being literally magic
@theojaffee: "He lives in New York and not in San Francisco, so he's not going to the exact same parties with the exact same people and the exact same monoculture all the time."
@schisofrenia: "We have, like, literally just topic mode collapse in SF where we all talk about the same thing and largely the same takes about the same thing."