Harness Engineer // building agentic infra and chasing the singularity // 1x Acquired β€’ CTO @QORIS_AI πŸ“© DMs open for advisory Β· Europe CET Β· remote

talk harness with me β†’
anthropic gave teams of 1 to 100 claude agents 24h to prove a hard math theorem 10 opus 5.5 agents scored 66% 100 fable 5.1 agents: 53% 1 opus 5.5 agent even beat 10 fable agents, 39% to 33%. fable costs 2.5x more per token the model matters more than how many agents you run, run your evals properly
1
2
95
source: anthropic's opus 5.5 system card, section 8.12.3 (page 193) www-cdn.anthropic.com/fc1b44…
1
46
happened to me too lol. if one of your messages trips anthropic's cyber safety filter, claude code switches you to opus 4.8 and stays there for the rest of the session. i ran ~1k turns on 4.8 in one session without realizing it subagents set to "opus" follow whatever the main session is on, so they get downgraded too your session logs in ~/.claude/projects record which model answered every turn, worth checking after long runs to lock subagents on 5.5, set their model to claude-opus-5-5 instead of just "opus"
so I'm taking a day out so I left opus 5.5 working on some bend2Β improvements. the results were TERRIBLE. completely stupid. I couldn't believe how bad its ideas were. I then asked: "are you sure you used opus 5.5?". turns out claude code silently routed subagents to 4.8?
3
160
Fable 5.1 still feels deeper than Opus 5.5 Next to Fable, Opus lacks depth in thinking and research, so these benchmarks are kind of deceiving a little Fable remains my daily driver. Though one has to say, Opus 5.5 is a huge leap from the previous Opuses, at least you can read it again
1
77
an obvious bug in Codex Conversation recaps are made even after you hit the usage limit. Seems like, as conversation summary is just a regular model request, it should fall under the limit. that almost makes me wonder whether one can get convo recaps limitlessly past the cap. Needs fixing?
1
1
134
Grok 4.7's take on Warcraft. 57 minutes of uninterrupted work within one session, 281k tokens spent, no edits. Honestly, I’m impressed
Grok 4.7 is here. It's a notable improvement over Grok 4.6 at the same price and speed.
1
10
826
Grok 4.7 is an amazing model. Right now its inference seems kind of slow though, Grok Build works at around 30-50 tokens a second. Wondering whether that’s because of the recent release and if it will get faster.
1
3
156
The question I keep asking myself: how truly good is Jev at generalisation? The obvious leap versus old classifiers is that you can speak to it in broad terms. The catch though is we still don’t have enough honest evals to know how far that leap goes. Published public numbers mostly measure agreement with two frontier models on four vendor workflows, not human ground truth on your own specific distribution. On short, well-specified calls it looks strong. On math, extra hops, noisy state, or a badly written question it gets literal and jagged. So the model is probably better than a frozen classifier and worse than the myth. The only eval that settles it is a few hundred of your own cases, a confidence threshold, and a look at what still needs a human.​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​ So eval it, eval it
1
141
jev makes me order Chinese over McDonalds and burger chains can you trust jev with your life choices? i think you definitely can
3
122
Trained a fly brain to play Flappy Bird - it navigates by vision, dopamine spikes and scent. Flies orient by scent, so the gap smells like food.
For the first time, scientists have mapped the complete brain and central nervous system of an adult male fruit fly β€” a key model organism in science. πŸͺ° Working alongside HHMI Janelia Research Campus and the scientific community, @GoogleResearch scientists and researchers used AI to combine millions of 2D images into 3D neural shapes, reconstructing a record-breaking 166,000+ neurons. This foundational map of the adult male fruit fly brain can help accelerate our understanding of the brain, and is a major milestone in neuroscience.
2
9
48
38,982
in opencode Astra is rushing to end its turns, even with explicit /goal style instructions - in Codex it operates much better. harness truly matters. I guess with frontier Anthropic/OpenAI models you’d just really be better off using native claude code & codex
4
262
opencode has just stopped supporting ox-alpha for free what a shame
3
10
826
AI writing useless tests is a context problem, and it's mostly fixable. β†’ The core issue: You cannot trust tests produced in the same context that produced the code. With the implementation in context, the session is conditioned on the very thing it's supposed to check. So the most likely token sequence for the test is a description of what the code does, not what it should do. The result is a self-confirming test that checks nothing. The obvious answer to that is subagents. But if you look at how harnesses actually launch them, turns out that's not really a viable solution. Subagents still inherit the AGENTS.md / CLAUDE.md, the tools, the skills, and a prompt written by the context you're trying to escape. If you look closely at the default prompts harnesses like Claude Code launch their subagents with, it's usually layers of text and tightening definitions. So you contaminate the context of a subagent anyway through the same-harness layer. Not a clean solution. What actually works is graph engineering: a pipeline of minimal, isolated nodes, each getting only the data it needs and nothing more. My setup: β€’ Minimal harness (I use Pi) β€’ CLI invocation β€’ Orchestration logic on top A quick example with e2e test generation and a simple three-step graph: 0. PRD β†’Β 1. User Flows β†’Β 2. Tests Node 1 sees only the PRD. Its one job is to invent the user flows that will actually happen when this ships, edge cases included. No code and no prior PRD-generation context. The flows get reviewed by a human (or an LLM judge, extra node) and fixed here. Node 2 gets the flows along with the codebase, and writes the corresponding tests. It reads the code, but what to test was already decided upstream by a node that never saw the code. So there's nothing (or at least much less) left to cause self-consistency bias. Then you get tests that check real behavior instead of confirming the code. The name of the game is isolation. Each node should be minimally scoped and blind to the others' reasoning. Want sharper tests? Add more nodes to mirror your architecture, and keep each new node just as blind.
ai writes so many useless tests
2
9
649
you can tell Ox-Alpha is a Chinese model by the way it outputs its reasoning it streams thinking for 5-7 minutes non-stop even on medium tasks. Gemini family models usually behave differently that gives a strong taste of GLM/DeepSeek (e.g. non-Western) type models
2
8
1,016