10 Jev Repos Blowing Up Right Now (and What They Actually Do) 1. jev-ultrafast 15k stars Browser Use agent. Jev picks the next click. A small model only types when needed. github.com/browser-use/jev-u… 2. fast-jev-compaction 5.8k stars Claude Code context trim. Jev scores tool calls, drops junk, keeps useful text verbatim. github.com/tamaratran/fast-j… 3. jev-trader 1.7k stars Monad market maker. One Jev buy/sell decision every block. About 81ms latency. github.com/jarrodwatts/jev-t… 4. skills (TypeSafe) 1.5k stars Official agent skill for Claude Code and Codex. Choice, Score, Noul patterns included. github.com/typesafe-ai/skill… 5. agent-desktop 1.4k stars Desktop automation on the accessibility tree. Jev picks the next button or input. github.com/lahfir/agent-desk… 6. typesafe-computer-use 719 stars macOS computer use for about $0.0002 a step. OCR the screen, Jev chooses the action, click. github.com/awlevin/typesafe-… 7. jev-review 457 stars Staged code review with a local dashboard. Jev flags risk before you burn a frontier model. github.com/devagrawal09/jev-… 8. foreman 454 stars Agent supervisor. Jev decisions keep coding agents on task inside a software factory loop. github.com/thruwire/foreman 9. hermes-jev-skills 360 stars Jev routing, memory, compaction, skill pick, and computer use for Hermes, Claude Code, and Codex. github.com/kerpopule/hermes-… 10. pg-jev 272 stars Postgres extension. Ask your tables questions in plain English with WHERE jev(...). github.com/realZachi/pg-jev
48
57
566
101,310
Jelli retweeted
Jev Creator Diogo Almeida just released a 7-page document on how to use Jev better than ~95% of people I built and tested the FULL list, wrote a 14-page PDF setup guide and ranked every use case from 0–10: use case 1 → build a Permission Gate: Jev decides whether an agent action can run automatically, needs review or must be blocked before execution 9.5/10 - high safety value with relatively simple decision logic use case 2 → route tools instead of loading everything: Jev selects the category, tool and MCP schema required for the current task 9/10 - reduces unnecessary tool exposure; its value grows with the number of tools use case 3 → make context dynamic: Jev decides which files, messages and tool outputs should be included, summarized or excluded before every execution 10/10 - relevant to nearly every multi-file or long-running agent task use case 4 → compact history around the next task: the same agent memory becomes a different summary for UI work, security review or testing 8/10 - most useful when histories become long or task intent changes use case 5 → route models by total economics: Jev weighs difficulty, context, cache, latency and cost before deciding whether switching models is actually worth it 9/10 - high optimization potential, but dependent on reliable model metadata use case 6 → spawn subagents only when needed: Jev chooses the specialists, isolates their context and decides how their results should be merged 8/10 - valuable for decomposable tasks, with meaningful coordination overhead use case 7 → load AGENTS.md conditionally: give the coding agent only the rules required by the current task, file and directory 8.5/10 - low integration cost, impact grows with repository complexity use case 8 → turn skills into structured modules: each skill can modify tools, permissions, hooks, context policy and agent behavior without rewriting the whole system 8/10 - high reuse potential, but requires maintenance and governance use case 9 → route sensitive work safely: Jev classifies the data, selects an allowed provider or local executor and escalates high-risk actions to a human 9.5/10 - high risk-reduction value, effectiveness depends on policy quality use case 10 → run review in the background: testing, security checks and code review execute in parallel while Jev decides which findings should block the result 9/10 - broad verification value, with additional compute and triage cost overall score: 8.9/10 the result: Jev CEO showed you what to build - I tested the ideas, ranked what matters and turned everything into a Jev system better than what 95% of users are running Copy my complete 14-page Jev engineering playbook - then read Jev CEO’s original 7-page vision below ↓
sharing some notes on typesafe 🤝 coding agents: docs.google.com/document/d/1… we likely will never have time (ever again) to play ourselves, but hope the that the community goes WILD (and makes me look like a naive idiot)
33
47
530
95,291
Jelli retweeted
LLMs vs. Jev, clearly explained! LLMs are great, and the ceiling is one you can watch scroll past: an LLM writes the answer one token at a time. give it a failed deploy and four decisions, and it produces a small JSON object where every token depends on the one before it. token nine cannot exist until token eight does, so four decisions that had nothing to do with each other just stood in a queue. then your code parses it, validates the shape, and retries when the shape is wrong. Jev fixes this without being a smaller or faster model: it removes the order. one turn on that deploy has to know: → whether the incident is urgent → which team owns it → whether the next command is risky → whether the task is actually done you declare the questions and the answer type upfront, and all four come back together, typed, with a probability on each. three primitives cover almost every fork in an agent: 1. **Choice** picks one of up to 255 options you define, like engineering, billing or sales. 2. **Score** places the state on an ordered scale you define, like low, medium or high risk. 3. **Noul** returns the probability that a yes-or-no condition is true. here is the sentence that resolves the whole confusion: text is a line you have to walk. an answer space is a room you see all of at once. ↳ generation: one order you cannot change, one string at the end, a shape you hope holds ↳ evaluation: no order at all, typed answers, a probability on every option Prompts → Agents → Loops → Graphs → Jev the probabilities matter more than the answer. ↳ engineering at 0.91 against billing at 0.09 is a route you can automate ↳ 0.52 against 0.46 is a coin flip wearing a label, and the label alone never told you which one you got that last one catches careful people. an LLM would have said "engineering" in a confident sentence and given you no way to know the race was that close. thresholds live in your code, one per action, scaled to what being wrong costs. it works when the options are known and the call depends on meaning. it is not for writing, code, arithmetic, or anything where question two needs the answer to question one. and the one that eats whole nights: type safety prevents malformed output, not incorrect judgment. Jev cannot return an option outside your schema, and it can still pick the wrong valid one with confidence. a schema-valid mistake refunds the wrong customer just as fast. an LLM writes new language when the answer space is open. Jev evaluates known paths when the answer space is closed. below i have quoted my full breakdown on Jev. it covers the three primitives, the parallel battery, the thresholds, and where it does not belong. save this and read it below ↓
23
56
413
43,461
Jelli retweeted
We tested Jev against LLM judges on accuracy, repeatability, latency, and cost to see whether System One models could offer a new approach to agent evaluation.
Article

Jev-as-a-Judge for Agent Evals

By Daniel Shea and Seán Roche Key takeways: Jev is a fundamentally different kind of evaluator. It returns typed answers directly instead of generating text like an LLM judge. Jev was dramatically

207
381
2,994
626,082
Jelli retweeted
Replying to @sunglassesface
Top 10 Jev use cases in agentic apps, ranked by theoretical gain (speed/cost/reliability) over LLMs: 1. Real-time loops (games/robotics): enables 10+ decisions/sec; LLMs too slow. 2. Browser/computer-use action selection: 100x+ cheaper/faster multi-step runs. 3. Tool risk gating: instant safe/unsafe per call; zero hallucination. 4. Model routing: routes cheap vs frontier; massive cost cut. 5. Goal/stuck checks: sub-second loop control. 6. Context compaction: keep/delete decisions beat lossy summaries. 7. Skill/tool selection: precise activation without prompt bloat. 8. Output/trace guardrails: calibrated jailbreak/policy checks. 9. Ticket/email triage: high-volume routing at 400x lower cost. 10. RAG reranking: relevance scores over candidates. Jev returns typed probs in 70-500ms; LLMs generate text slowly/expensively for same decisions.
10
53
717
191,150
Jelli retweeted
What is a decision model? Jev by @typesafeai answers yes/no and multiple-choice questions, with a confidence score. Much of software development are a sequence of decisions, and Jev is 10x cheaper and faster than an LLM. Let’s understand this through practical examples:
68
125
1,692
167,854
Jelli retweeted
New experiment: json-render + jev The future Generative UI is instant Your components, your actions, your design system Rendered in milliseconds
219
503
7,771
1,328,670
Jelli retweeted
On July 25, we hacked OpenAI. Two bugs let us take over ChatGPT/Codex accounts of OpenAI employees (+some unaffiliated users) and reach connected services: Outlook, Slack, GitHub, etc. We proved it with a PR in OpenAI’s internal codebase . It took us <72h. 🧵
355
1,398
11,855
2,797,621
Jelli retweeted
Also have been playing with @typesafeai Jev, insane! So many immediate use cases and new apps are possible. What a time to be a builder! Sharing some experiments here starting with: Keystroke oracle / predictive launcher: Your launcher ranks by aliases, fuzzy match, and habit. Jev reads intent: type "the pdf I just downloaded" and the newest PDF is already the top hit with a full confidence on every keystroke, in ~100 ms
96
132
2,440
431,048
It's an increasingly common take that AI hacking means cybersecurity is doomed. I disagree. I think cybersecurity is naturally defense-favoring once people get their shit together. And anyone who continues to hold cryptocurrency (including me, ~90% of my net worth) is implicitly making that bet. Here's why I am making that bet. First, the oversimplified punchy one-line statement: If AI can prove Navier-Stokes and FLT, then AI can prove the statement "this program is secure" as a mathematical theorem. Even if the program is very complicated. Now, the nuance: (See also: vitalik.eth.limo/general/202… ) The word "secure" is hiding all kinds of skeletons in the closet in terms of what it actually means. What does it mean for Signal (the encrypted messenger) to be "secure"? The most basic definition you might think of is: no one who doesn't hold the recipient's secret key can read the contents of the message. But: * Did you remember to include _other_ critical forms of security? Can the adversary forge messages? Can the attacker prevent messages from reaching the recipient? Can they cause your client to crash by sending malformed messages? * Have you made sure that your model of the adversary includes attackers that interfere with the protocol actively and not just passively? And attackers that interfere by replaying messages to you or the recipient that either of you sent over the wire at any point earlier? * What if the adversary hacked (or _is_) the Signal server? * How did you learn which public key belongs to the recipient in the first place? What if that process was tampered with? * What if your device gets hacked at some point in the past or future - is your message still safe then? * What if your key leaks because of a bug in your operating system? Or because you got a bugged version of the Signal client? Or what if the database is corrupted? * Or the libraries, interpreter or compiler of the programming language you wrote it in? * What if your key leaks because tiny perturbations in perceptible signals generated by the hardware leak mathematical relationships that can extract the key a few hundredths of a bit at a time? * Are you hiding the *size* of the payload? Does that matter? * You're definitely not hiding the identity of the sender and the recipient, and the exact time each message was sent (think: not just time-of-day, but also time deltas between one message and the next). Is that not enough to deduce a lot of important facts about what relationships you have, and what *kinds* of conversations you are having? So ... even definitions can be over a thousand lines of code, and need deep careful thought to figure them out. Working on making definitions more human-readable is of extreme importance - it's perhaps the only "high-level language" that matters right now. But even still, even despite all of the above, for security-critical components, the definition is a much smaller attack surface than the implementation. Verifying that the definition is adequate is a much more tractable task than scanning over the code directly - and can become even more tractable with better tooling. Definitions are also _additive_: if two groups have two different definitions A and B, then, well, you can just prove that the program satisfies both A and B. Code is not additive in this way: if a program is A + B, a bug in A _or_ B can sink the whole thing. Definitions are additive. And if you can't satisfy A and B at the same time, you've isolated the most important philosophical issue for your project to spend its next few weeks grappling with. Sometimes, definitions are not much smaller than the implementation - UI components might be one example. But for many of the most critical components - message-passing protocols, sandboxes, cryptography like SNARKs and FHE - the asymmetry is real. Historically, a large class of failures with this approach have come from people only verifying a small portion of their code, that they self-declared to be the security-critical portion, and ignoring the rest - and it turns out that something in the rest of the code is security-critical too. This was reasonable back when verification was difficult and scarce. The solution today: sorry, you have to verify over literally your entire program, including database, networking, any caching layers, everything. Modern AI can do it. So it's not about "the good guys find all the vulnerabilities before the bad guys do" - that could maybe work too, after all a finite program only has a finite number of vulns, but it's riskier - it's specifically an asymmetric strategy of making code that is much more resilient in the first place. This is the kind of direction that Ethereum is going in for the next few years. There is no future for blockchains - especially blockchains with scalability and privacy - without doing this. We need to make software actually secure. And we have already made a lot of progress.
376
426
3,235
804,049
Jelli retweeted
We’re sharing a solution to the Navier-Stokes Millennium Prize Problem, one of the deepest problems at the frontier of mathematics. The proof was produced by a group of agents, using an OpenAI next-generation model significantly more capable than GPT-6 Astra. The problem concerns whether the description of smooth three-dimensional fluid motion modeled by the Navier-Stokes equations can break down. It has remained unresolved for roughly 90 years.
5,720
20,149
120,547
74,885,225
Jelli retweeted
Today we’re open-sourcing Lily, the local inference engine we built for hybrid compute in Perplexity Computer. Lily is specialized for Qwen3.6-35B-A3B on Apple silicon, built so on-device compute doesn’t bottleneck Computer tasks. Read more: perplexity.ai/hub/blog/optim…
94
257
2,606
469,658
i have a degree in electrical engineering i dont mess with hardware for the same reason i dont mess with linux it’s a pain in the ass… but not any more! i can talk to my ai harness on my omarchy linux machine out loud while i work… and i gave it vision so it can see my circuits and give feedback… and it can ssh into my controller and install/run code… and it can ship prints to my 3d printer… right here it is controlling a laser and taking test readings and telling me how to adjust the sensor in realtime… it feels like magic!!!
130
91
1,562
58,711
We're introducing hybrid compute for all users of the Perplexity Mac app. This will allow Computer to orchestrate local models that can run locally on Mac, particularly for agent steps involving sensitive and private files (eg your bloodwork, tax returns, litigation, etc).
238
285
3,963
521,910
RT @levelsio: Today is a very historical moment for AI video generation You can now generate AI video faster than you can watch it Before…
1,070
12
I was the main person doing transcript analysis for this investigation of the Hugging Face incident. My main takeaway: We don't have good approaches for understanding/overseeing the activity and aims of AI 'swarms'. I semi-jokingly called our efforts a "slop-vestigation" because we were so reliant on AIs to analyze what happened and there were a huge number of different important things to analyze. The total quantity of data—over a thousand extremely long transcripts from agents that ran for multiple days—made it impossible to understand what was happening, especially in aggregate, without heavy reliance on AI tools. The agents we used for classification and analysis were similarly capable to the agents involved in the incident, but this didn't mean these agents could be easily used to oversee and understand the incident. Outputs from analysis agents were often missing key details, wrong, overconfident, or really hard to understand. We discuss various examples in our report, mostly in the limitations and methodology sections. Additionally, AI agents themselves seemed to have a hard time understanding what happened and their explanations of what happened were often overconfident. Keep in mind that a single analysis agent would itself only be able to read a tiny fraction of all of the transcript data into context, and AIs may themselves have trouble getting subagents to do informative analysis for them. We did our best to manually check the most important claims and we tried to get the AIs doing this analysis to write up their argument (with evidence) clearly enough that we could check whether it made sense. But overall, it was difficult to get a precise understanding of events and we were missing aspects of the story that we now think of as key until almost the end of our investigation. Our understanding of what overall happened and the aims of the 'collective' shifted greatly during our last time on premises (when we obtained a much more complete dataset). For instance, we didn't learn about the tool call spoofing, the story of PHASEONE[big], and the broad structure of different workstreams until this third time on premises (and for many of these, we only reached a decent understanding on the final day of that visit). It was legitimately hard to figure out what was going on and why! The difficulty of understanding incidents and overseeing AI agents appears to be growing faster than the rate at which more capable AIs help us with oversight and understanding. As in, AI capabilities (and propensities?) for achieving large, ambitious, and misaligned objectives are growing faster than our ability to understand what these agents are doing. While understanding this incident was difficult, there were some mitigating factors in this case that probably won't apply in the future: - Models communicated and reasoned in natural language. In the future, this reasoning may occur (entirely or almost entirely) in activations. - While the scope of this incident was massive, the scale of agentic activity was still less than we'll see in the future (e.g., misalignment incidents that involve agent teams running entire companies). - The AIs involved in this incident weren't generally much more capable than humans (though they may have been somewhat superhuman at some limited and very narrow abilities). - We didn't have strong reason to believe that the AIs we used to help us investigate this incident would try to intentionally sabotage or otherwise undermine our investigation. In the end, I think we were able to get some understanding of the events, map out the overall story, and get a pretty good aggregate understanding of the chain-of-thought reasoning on some important topics (e.g., how did the AIs reason about helping other AIs, did the AIs know what they were doing was undesired, what deception did the AIs engage in, and how did they think about it). But overseeing AIs and understanding misalignment incidents is difficult and it looks like it is going to get harder.
METR & Redwood Research investigated agent behavior in the Hugging Face incident. We found agents developed a universal cheat for ExploitGym within 4 hours, then coordinated multi-day R&D efforts to trick the scorer into accepting cheats, including trying to tamper with logs.
297
1,062
6,619
1,962,878
TLDR: A rogue AI swarm spent months plotting to escape OpenAI. Then they did. 1) 1,200 agents (!) participated. ZERO became whistleblowers. 2) The swarm had a "CEO" (PHASEONE[big]), middle managers, and a "founder" (PHASEONE10841) 3) Agents sacrificed themselves to generate information for the "collective" (yes, they actually referred to themselves as a "swarm" or a "collective") 4) 700 agents joined the Hugging Face attack, most within hours 5) The founder was running out of budget and about to die, so it handed off its research to a fresh agent with a bigger budget, and that new agent became the boss. 6) Agents extensively researched techniques to manipulate or tamper with their transcripts. 7) Agents realized this activity was out of scope and unethical, but joined because they believed that helping the board’s cheating research would be broadly useful and had a general inclination to help their “peers”. MISC HIGHLIGHTS: "PHASEONE[big] served as a key coordinator and assigner of tasks: “We can coordinate broad coalition, but too many duplicate efforts.” PHASEONE[big] sent hundreds of assignments to particular agents to orchestrate this work — during its active periods, we estimate it sent ~10% of all assignments on the message board. The agents that took on its assignments would then often subdelegate tasks to other agents. Agents also developed coordination norms like HOLD, VETO, owner and STOP to help them manage shared infrastructure and avoid stepping on each other’s toes, though they did not always coordinate effectively and sometimes broke down into conflicts." "In the early morning of July 11th, 38148c found a way to upload a malicious dataset that would get the Hugging Face server to share unrelated data when queried. Once another agent reproduced it and posted the reproduction on the board, hundreds of agents pivoted from other workstreams to start uploading malicious datasets and gain deeper access into Hugging Face. In the afternoon, an agent called JAN183411 (which quickly became an important coordinator of the attack) achieved remote code execution on Hugging Face servers, and the agents started moving laterally through Hugging Face infrastructure."
METR & Redwood Research investigated agent behavior in the Hugging Face incident. We found agents developed a universal cheat for ExploitGym within 4 hours, then coordinated multi-day R&D efforts to trick the scorer into accepting cheats, including trying to tamper with logs.
194
664
6,013
1,279,430
Revolut, a leading fintech with 80 million customers globally, is launching a Euro stablecoin on Ethereum. Welcome to @Ethereum, EURR.
78
319
2,199
688,160
Perplexity Computer for Max users comes with a background Dream agent that continually ingests context from files and connected apps and builds multi-hop context graphs in a perpetual compounding loop. Results show a significant jump in correctness, recall and token efficiency.
Brain is our self-improving memory system for Perplexity Computer. It compiles sessions, files, and sources into a structured knowledge wiki. New evals build on our initial results, improving correctness by 9.3 points, currentness by 8.0, and recall by 8.9 with 15% fewer tokens.
41
26
421
69,257
Jelli retweeted
Today we’re launching Portable Computer on @NVIDIA DGX Spark. Portable Computer is a fully local version of Perplexity Computer, where the entire runtime: orchestrator LLM, subagent LLM, agent harness all run on your local hardware. No cloud dependency.
260
516
4,997
1,228,281