Sending this with love to all my friends with weird harnesses, a bespoke collection of skills etc.
Just talk to vanilla SOTA models in the most boring way possible, it’ll be good
The worst part about AI engineering is how often does everyone think their weird esoteric bullshit actually matters.
I think it's a combination of sycophancy + non-determinism + models getting better so fast that you can associate model improvements with random changes you made to your environment. The result is that everyone's brains fall out as they overthink things that don't matter.