we found the same on our internal benchmarks
for many real-world eng tasks Opus 5 costs ~2x Opus 4.8 for similar performance
that said, I prefer Opus 5's code style
This chart says so much....
- Literally the exact same prompt.
- All long horizon one-shots.
- Totally reflects real-world experience.