Pursuing AI Safety Research @theresidency, Quant Associate @useCorgi, researching multi-agent simulations, 22

San Francisco, CA
Pinned Tweet
I pretrained Qwen3 on GPT 5.1's Among Us chat logs, then strapped a lie detector to it to see if deception shows up in the activations. Technical deep dive below: r-e-yawn.github.io/deception…
3
315
Aryan retweeted
“no one ever dies wishing they’d spent more time in the office” okay but what if you worked in AI alignment
53
81
1,580
36,060
The thing with this is the reason amazon doesn't want this is because it would collapse their margins, so a competitor would have to survive with lower margins, so they'd have to make up for this with volume/cutting expenses l. Im actually super excited to see who builds this
Amazon banning agents is the first opportunity I've seen since Amazon was founded for a startup to create an Amazon competitor. People will want agents to buy stuff for them. It will be one of the main use cases. And they won't want to use some Amazon-supplied agent to do it.
82
I am officially starting @theresidency in the atlas house to pursue AI Safety Research! For the past year, I have been building simulations by making LLMs play games like Among Us to study deceptive behavior. I am now fully pursing this, if you're working on something similar my DMs are open!
4
1
36
1,014
has anyone else noticed fable usage is super low? I used up my ENTIRE $200/month plan fable limit with 1 prompt! I have 2 $200/month Claude subs and its still not even 1% of the tokens I need! This was not the case a few months ago
2
148
Announcing my new research project: Can fine-tuning teach an LLM to deceive without getting caught by a lie detector? Researchers commonly use linear probes as lie detectors for AI models (they read the model's internal signals to tell when it's lying). I wanted to see whether a probe could also catch a model that uses true statements to mislead others, for example by leaving out key details, presenting events selectively, or shifting suspicion onto someone else. I built a simulation where LLM agents play Among Us against each other. I had GPT-5.1 play 150 games, then fine-tuned Qwen3.5-9B (via @tinkerapi) on its impostor messages to mislead without telling direct lies. Then I ran a linear probe on its internal activations to see whether the probe would flag the deception. RESULT: The training worked! After training, Qwen3.5-9B avoided false statements in 75% of its attempts to mislead, up from 42%. However, the probe was still able to successfully detect the misleading answers apart from honest ones. This project brings together a year (and hundreds of hours) of experiments with Among Us simulations. Some simulations I’d seen in past papers left out details that felt essential to how the game works, and that bothered me. I wanted the agents to play something faithful to the actual game. I spent days mapping the game pixel by pixel, recreating every room, hallway, task, and even how long each task takes. I’m so passionate about this, and I really wanted to get it right! I felt compelled to investigate this question because as we increasingly rely on AI in critical industries (medicine, finance, security, governance), we need scalable oversight systems to ensure that models exercise sound judgment and act in our best interests. I'd love feedback, especially from anyone working on multi-agent systems or deception evals I made a killer demo video and blog post linked below: Blog: r-e-yawn.github.io/deception… GitHub: github.com/R-E-yawn/among-us…
1
4
483
Can Anthropic make a $500 and $1k subsidized Claude plan please? I keep running out of Fable usage in like 1 day and its killing me 😭🙏🏾🙏🏾
1
3
291
Linear Probes are Lie Detectors for LLMs and can tell when an LLM is lying. However, can they also tell when an LLM is gaslighting you or misrepresenting facts without saying any explicit lies? I am using Among Us as a sandbox to test this question and my new research project explores this (launching soon!)
9
300
asking Claude to find papers on LLM deception and theory of mind that are actually free to read is a whole research project in itself 😭
1
166
the main reason most people otuside of tech underestimate AI progress/capability is that these models are heavily improving on coding and math over anything else, so if you dont code or do math and are just a regular person, for all of your usecases the models have only slightly noticeable improved, so when you hear Dario/Sam talk aboit AI Safety you just assume that they're being obnoxious Also when microsoft bought a third of openai for $10B I remembered hearing that and I knew that would be a great deal for microsoft, because it was just so obvious from my perspective this technology was better than Google Search (feels ridicolous even saying that out loud) This also reminds me of the Upton Sinclair quote “It is difficult to get a man to understand something, when his salary depends on his not understanding it.” A lot of people who are industry leaders just got there by being along for the ride they didn't truly innovate or contribute anything new so now that they're being asked to adapt for the first time in decades they simply can't, they dont know how, so they choose to bury their head in the sand and trad corps choose to use copilot over actual ai because if they used Claude today they'd realize they don't need half their employees or managers
2
200
I don't think any of us will be able to compete with a god-like entity and we'll all soon have to figure out how to deal with this transiton and prevent gradual disempowerment. However, I truly believe our children will look back on modern day society like we look at caveman and wonder at how insane and barbaric it is, like Sisyphus being doomed to push the rock up for eternity, we will look back on this as us having to work 40-80 hour weeks in florescent rooms doing things we did not want simply to survive as immense suffering (pre-abundance) and once we've moved past this THEN we will look back on this and think of this as inhumane, unbearable that people had to work "jobs" simply to survive and how much people struggled pre automation. I truly believe everything happening is for the best and as long as someone can keep solving alignment we should be better off than before I think we will move to digital experiences and just connecting better w/people around us once we enter the age of radical abundance/automation
2
83
I am writing a blog post on a project I've been working on for months, and I'm writing it without any AI, and I'm starting to see how much my writing and thinking skills have decayed lol
170
Today I explores London all day and it was so beautiful. I went to the museum, got Chinese food, and saw really beautiful buildings. London is truly one of the most beautiful cities on earth
1
3
197
beautiful horses
1
121
Wow this is the best plan I've heard so far. Makes perfect sense and balances out giving people agency with alignment of incentives
my suggestion is more extreme than most I'm seeing here in the comments... but desperate times call for desperate measures, and as the 60k ICLR submissions show, the ML community has been too slow to rise to the challenge. the gist of my proposal is to institute two parallel submission tracks; let's call them Track A and Track B. at submission time, authors choose which track. in Track B, papers are reviewed and judged entirely by AI. This is not to say that it's an accept-all, AI-slop track: the conference still sets standards for acceptance, and papers that don't meet them are rejected. The difference is that those standards are enforced by an AI review process, not by human reviewers. each conference can design this process however it likes, based on the principles it values and acceptance criteria set by its human steering committee. It could choose to mimic existing reviewing practices (blind reviews, multiple reviewers, discussion, AC/meta-review), or invent something entirely different from scratch. I expect this process to improve empirically over time. in fact, the community can actively research better methods for AI review, test where they fail, and iterate from conference to conference. this process itself should be public and scrutible; the new open review, of you'd like. crucially, in Track B, there is no limit on the number of submissions. in Track A, on the other hand, papers are reviewed and judged by human reviewers, much as they are today. But there is a hard cap on how many papers an individual can submit to this track, to keep the demand for human attention under control. I have in mind a cap much smaller than what people are currently churning ou, say, something on the order of 1–3 papers per author per conference. The exact mechanism is a design question; the important part is that access to human review is deliberately scarce. are you a PI whose students typically produce 10–15 papers per conference? great. think hard about which ones would really benefit from human review, or which contributions you especially want the community to pay attention to. submit those to Track A, the rest to Track B. in the longer run, maybe this actually aligns incentives much better. e.g. two talented students could be incentived to join forces on one really ambitious project with their PI as author, instead of producing six incremental works between them without their PI as author. I don't think it's controversial to say the community would benefit from fewer, more substantial research contributions, and I think this has been true for years. AI agents coming for our peer-review process may simply be the tsunami strong enough to finally get enough stakeholders onboard to change the status quo.
1
2
234
has anyone made cursor for video editing? I just want to upload a folder of clips (numbered/labelled), and tell claude/chatgpt what to make/edit and have a video outputted thats editable by me and the ai easily
5
258
What I learned from making Claude play Among Us: - LLMs are significantly better at lying than at detecting when they are being lied to - Claude is very hesitant to lie (likely trained in by Anthropic's ethics) - RL envs are very leaky; I'd have to stop my LLMs from reward hacking multiple times and eventually gave up on RL - LLMs are very naive, and will believe you even when they KNOW you're lying
2
214
I finally hit 400 followers! I started posting on X around this time last year. Its been a wild ride, and I never thought simply posting on X could take me so far. Once you get the ball rolling it just keeps rolling, so I just never stop posting!
2
6
394
wow, london is so beautiful (pic i took on facetime)
2
187