On the write path @hevmind

Denver, CO
Pinned Tweet
I have been experimenting with various marketing automations the last few weeks. Give @hevmind a follow to get curated tweets on retrieval, evals, and agentic AI.
Credit to the 'just nest more folders' school of agent memory — infinitely organized, and somehow never where the answer is.
2
516
Starting in ~40 minutes.
We'll hear from @aHev an 1.5 hours on his fun work with agentic memory at Retrieval Augmented Gathering, hope you can make it! maven.com/lls/f27953
2
73
Cool to see my research get picked up by the team @turbopuffer Always impressed how quickly they ship.
native reranking is now in private beta rerank query results using state-of-the-art reranker models, including Jev, without a third-party API call contact us for access
1
6
235
Adam Hevenor retweeted
The trace archive is big and cold; what you want back is small and hot -- a storage decision before it's a model one. Free lesson on the archive layout, Sep 25 with Doug Turnbull. maven.com/p/309f49/your-agen…
1
1
33
Okay, so quite a few folks have reached out about my reranker with jev. I made a few updates to my benchmark posts. * Shout out to @mixedbreadai for having the best performing model in terms of quality * Jina was on par with the rest. * The comparison's are incredibly close
3
2
2
323
Adam Hevenor retweeted
Calling it now: the trend of putting control flow in markdown for agents (skills, prompts, etc) is going to look *really* silly in a couple months
120
25
667
185,971
Jev proves that having pre chatGPT ML experience is extremely valuable but no longer what you need to build practical systems.
69
Oktember to remember
1
69
I built a simple reranker using Jev that performs on par with Voyage, and outperforms Cohere and Mixed Bread hevmind.com/writing/jev-as-a… github.com/hev/reranker
1
1
4
246
Yes, I am changing!
1
51
Adam Hevenor retweeted
We want search failures labeled by stage: missing from the candidate set, retrieved but ranked low, or present in context and ignored. Each failure sends us to different code. 'Bad answer' is too coarse a bug report.
1
12
Adam Hevenor retweeted
Filtering to 178 rows before ranking is what makes skipping the ANN index the right call — exact cosineDistance at 14ms only holds because the WHERE clause did the real work first.
Agent memory retrieval is rarely an unfiltered top-K. Usually: this user, last 30 days, this topic. 1M turns with 384-dim embeddings in chDB: that WHERE prunes to 178 rows. Exact cosineDistance over them, cold Python process: 14ms. Ranking all 1M: 250ms. No ANN index needed.
1
1
55
Adam Hevenor retweeted
A flag that silently falls back to full scan instead of erroring is the sharp part — dropping index_granularity from 8192 to 128 took p50 from 43ms to 11.5ms, which is exactly where the real cost was hiding.
Sharp find in this RAG retriever benchmark: allow_experimental_vector_similarity_index must be set at query time too, or ClickHouse silently falls back to a full scan. index_granularity 8192 -> 128 took p50 from 43ms to 11.5ms. qiita.com/kenimo49/items/c5c… @kenimo49
1
1
54
Big week for artifactory!
1
47
This looks so 🔥
Quick Superlogical demo to end the week. This demo is just of the basic functionality, but I want to highlight just how FAST it is. There's a WHOLE lot more functionality already present and coming but I wanted to keep the demo short. But seriously, check out that speed. I'm showing the macOS app here and I get asked a lot so let me just say up front: its not macOS only. We're still figuring out exactly what platforms will be stable enough for the initial public release, but we're working on others. In particular, the web interface is very functional but I'll demo that another time (or someone else will). This is also all showing off the architecture I previously talked about for terminal multiplexing which is significantly different from other mainstream multiplexers: this is all a custom binary protocol where the server is maintaining N replica distributed terminal state machines. It works! Tons of hard work going into this by the team @almonk @dizzyup @pearkes. Hope we can bring you something you can use soon. ❤️ Happy to answer questions in the replies.
101
Adam Hevenor retweeted
Two questions that break most benchmarks: recall measured with filters on, and multi-tenancy first-class or a where clause you'll regret? Published numbers are unfiltered. Yours won't be. hevmind.com/research/vector-…
1
20
We need more awareness here. I see this alot with my clients and it is in fact quite sad when engineers dig in like this. It eventually becomes something they can't reverse on and an identity crisis.
there’s a post I keep hesitating to write, but have mentioned offhand in pubs, podcasts, probably some tweets as well. about very senior engineers who have painted themselves into a corner by being absolutist anti-ai, and have rationalised it deeply, and made/making themselves completely unemployable. it’s super tragic to see. we need to give them some kind of offramp, but probably won’t because what exactly is the benefit to the olive branch presenting person? and yeah I’ll say it, being on bluesky is corrupting for this reason. you’ll have the constant applause from others who are in the same position, and feel completely validated in your decision, and fade into the nothingness. it’s like these people forgot what being a technologist really means, what the job is, how to be practical and adjust to a changing world. corrupted by pithy ideology that doesn’t survive contact with reality. ps - don’t use this as an excuse to be cruel to them, I see the thigh slapping self congratulatory types as well who enjoy seeing this train wreck play out. (replies limited for this one, I only discuss this with my friends in person sorry.)
1
151
Adam Hevenor retweeted
The default move is blaming the retriever before diffing tokenizer configs. Cheaper theory, worse postmortem. How many 'search is broken' tickets on your end turned out to be silent preprocessing drift?
When vector search returns poor results, check whether the query and documents were embedded using the same model and preprocessing steps before assuming the search algorithm itself is broken. Mismatched embedding pipelines are a far more common cause than the underlying search logic.
1
40