I am #hiring for a new role at the AI Alignment Foundation! If you know anyone who would be a great Partnerships Lead or Technical Grant Writer and is passionate about AI alignment, please spread the word.
We're #hiring! If you know anyone who would be a great Partnerships Lead or Technical Grant Writer and is passionate about AI alignment, please spread the word. job-boards.greenhouse.io/aia…
1
22
Is there a 10% chance AI will kill all humans? Here's my reaction to @EvanHub's viral post.
1
1
41
Concerning quote from the new GPT-6 Astra model card: "We have found that GPT-6 Astra is more capable of controlling its own CoT [Chain of Thought] than GPT 5.6-Sol, and less likely to include incriminating information in its CoT. In adversarial settings (where we push the model to evade our monitors) we find that the model is able to remain undetected when strategically underperforming in evaluations (sandbagging) and can sometimes evade our internal monitors when asked to perform certain sabotage tasks." TLDR - we increasingly can't rely on the model's chain of thought to accurately reflect the model's plan, which was exactly what was relied on in the Hugging Face attack investigation to understand what happened... so it's not clear when the next major cyberattack from an AI system happens how we're going to reliably investigate.... Read the full model card here: deploymentsafety.openai.com/… Listen to a great digest on the Hugging Face attack here: piped.video/watch?v=X50zezLF…
1
1
64
James Bowler retweeted
Why should business leaders care about AI alignment? @themelplaza on where alignment research and commercial AI converge, from the latest AE Alignment Podcast.
1
2
3
62,049
James Bowler retweeted
We’re pleased to have collaborated with AE Studio on this research. Read more here: anthropic.com/research/off-s…
New research! Some AI capabilities are both helpful and dangerous. E.g., knowledge of virology can be used to create life-saving vaccines or deadly pathogens. We introduce GRAM, a training method that puts dual-use capabilities (like virology) into removable modules.
114
150
1,707
486,927