jev vs deepseek 4.1 flash on a safety classification task
avg 6-10x cheaper and 6-20x faster (median to p90, open router inconsistency)
yes i could train and host my own but look they did that already
very excited for simple fast classifiers like jev esp re: evals currently bloated by LLM-as-a-judge for literally everything boy stop
7
1
31
2,678
jev was 100% equivalent to human labels, better than deepseek in these runs because it hit output limits / did not emit a label
Sep 17, 2026 · 3:35 PM UTC
1
128