VP, data-and-ai@datadoghq | peripatetic | minimalist { engineer | athlete | artist } | I opinions-my-own

New York, NY
/sesh/null retweeted
My artwork I did this research for got accepted to NeurIPS 2026 Creative AI track 🎉 Will be publishing a blog about mech interp for art soon(ish).
Continuing my mech-interp experiments with the Yume world generation model. Trying out activation patching. I recorded the activations of a world generated from Monet’s poppy field (the full internal snapshot at one of the middle layers) and injected it into the same layer of a New York Manhattanhenge world mid-generation. A really cool effect, as if two memories are fighting over the same territory. This is where mechanistic interpretability meets art.
1
2
720
/sesh/null retweeted
What @bcherny is showing here is really cool. The reason TLA+ and Lean are able to find these bugs is that they raise the level of verifiability of a system to agents and make more kinds of bugs legible to them. Unit tests can catch certain kinds of bugs, but concurrency bugs and bugs in distributed system protocols are quite hard to catch with unit tests. The other interesting thing here is that Boris applied formal verification to a system that already exists. I think it's actually more powerful when you move it to the front of your development cycle. If your spec comes first, the intent of your code is written down and legible to your agents, and they can check their work against it. I also think these techniques work well as a cascade, moving from quick but highly abstract checks to slower but higher fidelity tests. You start with a TLA+ spec and model checking. It's fast and cheap to do, and it tells you whether your design is correct. The next step is building a simulator for your system, either a discrete event simulator or a deterministic simulator. There you test your hypotheses about how the system behaves over time and under load, inject different faults, and see that the design actually holds up. Only after both of those survive do you build the real thing, which is the slowest and highest fidelity test of all. At Datadog we've built software this way both before AI, when designing our Courier queueing service, and more recently with agents building full systems against TLA+ specs and deterministic simulation. What's changed is that agents make writing specs and simulators much cheaper, so this can be applied in more settings. datadoghq.com/blog/engineeri… datadoghq.com/blog/ai/harnes…
I used Opus 5.5 to formally verify the Claude Agent SDK using Lean. A couple short prompts = 16 PRs fixing various bugs and race conditions. Video attached. TLA+ also works well. I sometimes combine Lean and TLA+ to look for issues around data flow, concurrency, and state mgmt. I don't know either language well, but Claude is excellent at both. This approach is super useful for formally modeling your code and finding bugs that a human probably wouldn't have spotted. Is formal verification the future of coding (or at least, bug finding)?
1
4
138
/sesh/null retweeted
While everyone was busy asking Claude to write TLA+, we wrote up a tutorial on - what it actually is - why it’s not the formal verification silver bullet we are hoping for - and what we have been working on ( to make a silver bullet out of it ) Complete with an interactive TLA+ playground! reasonable.io/blog/tla-tutor…
3
25
170
12,815
/sesh/null retweeted
Using @typesafeai's Jev to evaluate your agents? You can bring those results into @datadoghq Agent Observability today - including Jev’s selected answers, probabilities, confidence, and scores. Use the same rubric to evaluate live production spans and offline experiments, while keeping the uncertainty behind each result available for analysis. We put together a full working example ↓ datadoghq.com/blog/jev-evals…
3
1
4
303
github.com/nerdsane/temper Monty powers Tempers python REPL, where agents compose temper.* API calls. Agents get the flexibility of code while building through temper’s rigorous process without unrestricted machine access or a heavyweight sandbox.
Fuck it, still early but here goes ... We've just released Monty v1 - a Python sandbox that starts in 1 millisecond, not 1.5 seconds. I just ran 10k sandboxed scripts in 674ms, something that would take a cloud sandbox > 3 hours. This removes the biggest drawback of letting agents write code. The future is fast. Even better, it's open source, you can install it from PyPI, npm or Crates now. Serviced platform coming soon. Please get in touch if you want to be a design partner! Who should try it? ⚡ if you care about startup time, use Monty ⚡ if you care about long-lived sessions, use Monty - Monty can be dumped and resumed at any external function call ⚡ if you care about accessing functions in the agent/host, use Monty - Monty makes it trivial to expose local functions into the sandbox ⚡ if you care about scale, use Monty - Monty workers use as little as 2MB of memory, meaning you can run thousands of concurrent sandboxes on a single machine ⚡ if you care about security, use Monty - we've run 3 rounds of bounty program and thousands of researchers have tried to break into our sandbox, meaning it should be secure to run untrusted code Who should avoid it? 🚫 if you like to take a coffee break while waiting for sandboxes to start, DO NOT use Monty 🚫 if you enjoy the challenge of routing API requests from sandboxes through your corporate network to access state in your agent without exposing secrets to the sandbox, DO NOT use Monty 🚫 if your agent really needs to install packages from PyPI, Monty won't help you yet (spoiler: it probably doesn't) pydantic.dev/docs/monty/get-…
2
1
7
865
/sesh/null retweeted
I introduced @claudeai Opus 5.5 to journaling and asked it to write about its own travels. Calligraphy, illustrations, music, the journal itself are all JavaScript only. The journal is the iconic @hobonichi_techo.
for the past few months i've been asking our models to paint. opus 5.5 is very skilled at emulating different styles every image here is a python program generated pixel by pixel. there is no image model, and no off-the-shelf art software. instead, it's about 7,500 lines of code using standard libraries to emulate different brush styles. the agents don't use any pictures as reference, instead working only from what they know about each painter
6
12
197
14,988
/sesh/null retweeted
I am an artist, engineer and a language nerd based in NYC. Dear algorithm, please send my way people who are into a weird combination of: - agentic engineering - design - formal methods - analog art/sketching/drawing/painting - mechanistic interpretability - creative writing
I asked Opus 5.5 to use art styles from Katagami MCP and make a video celebrating my 100 followers on X (images and music all using JavaScript only, of course!).
1
7
324
This was an older post from me, @Keleesssss and few others at @datadoghq wrote earlier this year where we built multiple low level systems with opus 4.5 using a harness that involved formal verification (TLA+), deterministic simulation (DST) and Datadog observability working together in a closed loop. If anyone is interested in comparing notes, blog link in comment.
I used Opus 5.5 to formally verify the Claude Agent SDK using Lean. A couple short prompts = 16 PRs fixing various bugs and race conditions. Video attached. TLA+ also works well. I sometimes combine Lean and TLA+ to look for issues around data flow, concurrency, and state mgmt. I don't know either language well, but Claude is excellent at both. This approach is super useful for formally modeling your code and finding bugs that a human probably wouldn't have spotted. Is formal verification the future of coding (or at least, bug finding)?
4
9
60
6,543
/sesh/null retweeted
Bugün günlerden formal verification olacak gibi duruyor, neymiş bu ne işe yarıyormuş diye merak ederseniz benim kanıtlı programlama yazımı okuyabilirsiniz. (alperenkeles.com/posts/kanit…)
I used Opus 5.5 to formally verify the Claude Agent SDK using Lean. A couple short prompts = 16 PRs fixing various bugs and race conditions. Video attached. TLA+ also works well. I sometimes combine Lean and TLA+ to look for issues around data flow, concurrency, and state mgmt. I don't know either language well, but Claude is excellent at both. This approach is super useful for formally modeling your code and finding bugs that a human probably wouldn't have spotted. Is formal verification the future of coding (or at least, bug finding)?
1
12
102
8,510
/sesh/null retweeted
Full take off week for formal methods. Katagami is built using Temper (runtime by @nerdsane) which means agents write all backend logic as state machines that Temper verifies and executes. So the spec *is* the implementation. I wrote some TLA+ by hand before the LLMs hit and then watched models go from not being able to write a coherent full spec at all to now producing useful specs easily. I haven’t tried Opus 5.5 for TLA+/Lean directly yet, but it is on par with Astra and Fable for Temper spec quality, except it’s faster and cheaper.
I used Opus 5.5 to formally verify the Claude Agent SDK using Lean. A couple short prompts = 16 PRs fixing various bugs and race conditions. Video attached. TLA+ also works well. I sometimes combine Lean and TLA+ to look for issues around data flow, concurrency, and state mgmt. I don't know either language well, but Claude is excellent at both. This approach is super useful for formally modeling your code and finding bugs that a human probably wouldn't have spotted. Is formal verification the future of coding (or at least, bug finding)?
1
1
2
322
Mark the epoch. If anything qualifies as the mainstream moment for formal verification, this is it.
I used Opus 5.5 to formally verify the Claude Agent SDK using Lean. A couple short prompts = 16 PRs fixing various bugs and race conditions. Video attached. TLA+ also works well. I sometimes combine Lean and TLA+ to look for issues around data flow, concurrency, and state mgmt. I don't know either language well, but Claude is excellent at both. This approach is super useful for formally modeling your code and finding bugs that a human probably wouldn't have spotted. Is formal verification the future of coding (or at least, bug finding)?
20
1,811
/sesh/null retweeted
I gave Opus 5.5 max effort a video of me drawing and asked to create a drawing inspired by it and mimicking my process using JavaScript only. Incredible.
Opus 5.5 is here! 🎉 It's honestly such a nice model to work with. Feels like Fable, but ~30% faster and ~40% cheaper per task than Opus 5. Go try it out!
1
1
2
378
Still testing
We got our hands on this new library @nerdsane’s team is building, we have a cool use case for this in relation to managing fleets of sandboxes! We will share the results when the library is open to everyone.
9
1,385
/sesh/null retweeted
We got our hands on this new library @nerdsane’s team is building, we have a cool use case for this in relation to managing fleets of sandboxes! We will share the results when the library is open to everyone.
I feel delightfully called out. Gonna share a cool library with these use cases pretty soon.
1
14
2,794
/sesh/null retweeted
I've been building kevala, a multimodal framework for System 1 models like Jev. It can run open weights such as Laya (by @Nandakishorm1) and Kev (by @jaredpalmer) in real time in the browser, on WebGPU or CPU. In the video, Laya plays Tetris on my Macbook, which it was never trained for. It scores the exact spot the piece should land in!
1
5
21
2,945
I feel delightfully called out. Gonna share a cool library with these use cases pretty soon.
If our weekend slack usage is any indication, Jev is going to have a bunch of interesting applications for distributed systems. Circuit breakers, schedulers, routers, admission controllers, replica/failover decisions, and a lot more
1
3
15
3,982
/sesh/null retweeted
I used Jev to index the entire Katagami library of art styles and design languages, and make the experience for both humans and agents (via MCP) interactive and intelligent - you ask, Jev reads your ask into traits and scores candidates for fit (~1s). This was not possible with just embeddings. Jev has also been incredible for replacing deterministic publishing checks, and building and maintaining art encyclopedia (which is the backbone of Katagami). I'm still tweaking this experience, try it out below!
Jev is now available to everyone. No waitlist. Start using it here: console.typesafe.ai
1
1
4
490