Fuck you,
@ArtificialAnlys
Your new index says Claude Haiku 5.5 is smarter than DeepSeek V4.1 Flash 1017 and GLM-5.3.
Haiku is Anthropic's small cheap model. DeepSeek 1017 is the model Cursor put on its cost frontier this month, and Cursor says no model scores higher at those prices. I run it every day on my 4x 3090. I dont believe for a second that Haiku beats it.
Look at how they got there. 60% of the index now runs on private tests nobody outside can see. GDPval-AA, SciCode and the long context test are gone. In comes a private coding benchmark from Cognition. And the open weights gap goes from 3 points to 12 in 1 release, 4x. Released open models are now 26 points behind the top.
1 day before v5, on the old version, they gave Ling 3.1 Flash 1019 a 44. Now the best released open model gets 32.
The weights didnt change. The tests did, and you cant see the tests.
This is a bought benchmark. A leaderboard where you cant check a single question, that widens the gap 4x overnight and puts Haiku above DeepSeek, is marketing for closed labs. Its not measurement. I hope at least you were paid enough money to publish such garbage. Liars.
Publish the questions or stop calling it an index.