You don’t seem to get me or I am explaining poorly.
I need to see:
1. Specific algorithm / setup / workflow / process / software that is being used, step by step and explanation why it works and how.
2. Results from using that specific method and explanation why these results were achieved only by applying the specifics in #1 and not something else
Example:
1. I setup OpenCode with beads, Plannotator, Coherence, full access to codebase for e-commerce app, connect MCP to observability stack: Sentry, Coralogix; CI on Gitlab, and scripts for: setup repo, ci run, deploy (staging/prod)
During development I formulate requirements coming from multiple sources: customers, customer support, owners, other engineers, design team, GTM and security guy. I write a spec worh acceptance criteria into Coherence. Then let agent plan for code updates based on that updated spec. I review plan and make adjustments to it, then let agent handle code writing testing and so on.
After it is done, a PR is created with interactive demo i can touch and verify my understanding of the new behavior with intended one and merge it only when I have full confidence the code will be working exactly as I wanted. I still have to read code here because interactive game is not enough but helps build mental model of it.
Now, after shipping i monitor metrics that were also created and attached to spec that we just shipped, for example “amount of conversions after visiting the page with CTA button we just shipped” — hey this page converting 3% instead of 2% because we were thorough in requirements collection and wrote good code that did what we intended. Specifically, made the button standout and easier to press on, and removed a bunch of text, so button appears earlier on the flow.
In the result, what we observed:
- conversion improved by 1%
- the effort we spent on building this agentic AI pipeline: 3 engineers full-time over 8 months
- e-commerce app ARR: $20k
- ARR increase from that conversion increase: 4%
- new ARR: $20.6k
- money spent on engineering: $240k
- ROI: we’re broke
———
This is what I want to see.
Not “we have cool results but go ask agent to tell you how it’s done, because am too busy/ignorant/lazy/whatever and not gonna help you”
Agent cannot generate me these results out of thin air, only real business and real people can.
But they won’t.
Because there is no benefit they can show.
Otherwise I’d have seen these numbers and exact cookbook to steal and get +x% arr growth or -% bugs or 2x productivity boost connected to actual meaningful metrics rather than “we were shipping 3 PRs a week and now we do 30 PRs but we don’t track metrics because who the hell does that? We ship code, not value”
🎤