Just finished up a 5,000 line AI-assisted React PR for work. Combo of 5.6 Sol and Fable 5.1. Honestly I feel like handwriting it might have been faster and less frustrating.
The diffs are horrible. It’s so cognitively taxing to review components. I want to review what state was added, and then state transitions, and then the effects, and then the view. I don’t want it all bundled, and I don’t want to have to reconstruct all the implicit behavior in my head. (Also the tests suck to read.)
And idk if this is real, but it seems like even the domain type files with pure functions get worse when the agent knows it’s writing React. The names are weird, the boundaries are awkward, and it just all feels wrong in a way that’s hard to explain to the agent.
I’m convinced tool choice matters now more than ever. If the current frontier models aren’t banging out big React PRs at a very high quality bar, I don’t really see how the next wave of models or the one after that is going to solve this. I think the space of plausible implementations is too large, and the component-centric paradigm is too permissive.
Anyways, I’m more confident that constraining the solution space and generally giving agents fewer legal moves will pay off big time.