New in Claude Code: claude plugin eval See what value your plugin is adding, or if it needs more work. You can create test cases, run your plugin or skill against those test cases, score those runs, then run each case again without the plugin to see the differences.

I really wonder how will be the saas model? Here @treg_ai let us access to 2800+ saas and pay as u go!

Fabel 5.1 is where finally I feel claude code talk concise and relevant! It gets the point much faster, do not generate long essay result for a simple question and so far so good!

I think paying for all LLM should become pay as you go! Pay only when u use and not monthly subscription! Unless u r a heavy users. Is that something u look? Check this treg oss library and hosted version

An AI agent to make sense, needs many tools, or better to make many api calls, and imagine if you want to subscribe to each of em and never never to their cap! How come you make that agent into a profitable business? The solution is a proxy that lets you pay just for the API calls you make! Here @treg_ai is doing that and more: tool routing, team account, remvoe the need to share api keys between team members and many more.

Ok the mystery the ox-alpha is GLM-5.3-Flash, And modelprint.ai was right! ox alpha was the first real test I did. day one, the fingerprint said glm family, 4 of 4 tokenizer probes. day five, z.ai confirmed it. today i reran it on the official glm-5.3-flash endpoint: same values, 47, 56, 60, 90. the label changed, the model did not. anyway the guessing game was fun, but it was not the point for me. but the real question: can you fingerprint a model from its behavior alone, without access to weights? even for open models, reading the weights is slow. behavior is fast. if that works, you get something bigger: a version control system for models that does not depend on the lab, the provider, or anyone's word. the API itself is the source of truth. so now it is a tool, and it is open. join, contribute, add probes. and when the next mystery model appears, we run it again. modelprint.ai

The fingerprint from launch day, still open: nitter.net/unclecode/status/20907… Bloomberg's confirmation: nitter.net/business/status/209254… Anyone can re-run it. No leaks, no sources, just the API telling on itself.

Back to OxAlpha fingerpting, the modelprint has a home now: modelprint.ai And a memory. Every day it fingerprints 21 models, each locked to one provider, and records what it finds. A new entry is written only when a value actually changes. modelprint.ai/history So when someone says a model "feels different today", there is now a place to check instead of guess.

大神出手了，以后新模型是哪家的不用猜了。 这个modelprint开源工具解决了这个问题，今天的Ox Alpha 确定了是GLM 新模型！ 工具地址： unclecode.github.io/modelpri… 开源代码库在这里： github.com/unclecode/modelpr…

Update: tested the last untested suspect through Xiaomi's official MiMo API. mimo-v2.5 matches the mystery on 2 of 4 tokenizer probes, v2.5-pro on 0 v2.5-pro on 0 of 4. of 4. The emoji probe separates hardest: 90 tokens vs 57. GLM stays the only 4/4. Last suspect cleared.

Run it: unclecode.github.io/modelpri… No install. Your API keys stay in your browser tab, calls go straight to the provider. Every probe is one small JS file, and adding your own is a pull request: github.com/unclecode/modelpr… start it, we can add more probs for future models