Co-founder @Calibre_Labs | Applied AI research & consulting | Agents, AI Evals | prev EVP @amplitude_HQ | VC @khoslaventures @sequoia | @stanford @iitbombay
In our work at Calibre with AI product teams, @justinjbauer and I are often surprised by how many PMs have never written an eval rubric. Even those building agents with customers in production won’t
Sam told us intelligence would be “too cheap to meter" but so far, the AI industry seems to be doing a pretty thorough job of metering it - to the count of ~$200B in annualized revenue as of last
In the era of agent experience, performance will become the new competitive advantage for great SaaS companies In January 2025, we first started debating the “death” of software. Anthropic had just
It's become almost banal to talk about talent density in Silicon Valley, but at this moment, AI is creating a new pattern. Teams and companies that haven't embraced it are at risk of having their best
TLDR Most enterprise AI agent launches end up stagnant - not improving over time once shipped. Roadmapping/product review processes don't work AI product teams need to build a flywheel system to hill
In huge personal news, @justinjbauer and I started a new company last year - Calibre. We are an applied AI research and consulting firm. We aim to work with CXOs and product leaders to help launch