This is an extremely good watch.
The things that felt novel/interesting to me:
1. Lock down your agents
Humans tend to like 'sharp knife' abstractions - that are powerful, but you can cut yourself if your use them wrong. Lauren says agents perform much better in extremely locked-down environments. Abstractions are designed so they can't screw up, and lint rules enforce it.
They built a whole internal framework (Dune) to keep the agent on track.
That helps optimise agents that don't have a large context window to work productively in your codebase.
2. Create verification infrastructure
To trust the results of any agent, you either need to sit and watch it OR have it provide evidence of its improvement. This has always made sense to me, but Lauren really pushes it hard here:
- Invest in custom CLI's that let the agent drive the app and measure its performance
- Make the app "factory ready" from the get-go - i.e. deployable to an environment where the agent can mess about with it
3. Feature Maps
Lauren's software factory (what she calls an 'outer loop') often requires the agent to break down vague bug reports from users and to turn those into potential fixes.
To aid that, they built a 'feature map' of all the main features in their application, which describe exactly how the app is supposed to function.
This has become essential for helping the agent navigate the codebase, and figure out quickly how things are supposed to work. It's maintained along with the codebase, and kept in sync via automations.
This is the kind of documentation I usually warn against. It goes stale quickly and can confuse agents if it's not kept up to date.
But Lauren's team are using it as critical navigation infrastructure, and it makes it possible for agents to explore faster and better - even on a large codebase. So it sounds like navigation docs like this are worth it if they enable new behavior.
Banger talk - watch the whole thing on 2x.
here's how i shipped 2,500 PRs last month to production
this was originally supposed to be for Cursor Compile in London. i couldn't make it since i was livestreaming for Grok
@Bot Galaxy so i'm making it available for free here on X! watch it on 2x speed, i talk slowly