Honored to have contributed to this research, which I think could shape the standard for evaluations of how AI models impact users.
Transluce received privileged access to both OpenAI & Anthropic data, in order to develop realistic simulations of users in mental health crises.
Today, Transluce is releasing the most expansive independent evaluation to date of how AI systems respond to users experiencing mental health crises.
We evaluated 77 model variants from OpenAI, Anthropic, Google, Meta, SpaceXAI, Thinking Machines, DeepSeek and Moonshot AI.