In recent weeks, when it came to tricky bugs (a memory leak, a routing issue, a sharding bug), Claude’s initial analysis was almost always 100% wrong.
I had to give it multiple hypotheses, clues, ideas, suggestions for it to solve the bug.
When asked “so, what did you learn?”