This is one of China's most formidable advantages: 93% of the Chinese believe AI will help their country. Only 36% of Americans do. These are dire numbers for the US. We have to turn this around.

Pretty insane result They spent 130 hours, 75B tokens, and $2.6M on RL to achieve this result

Looks like today may be a record day for token volume % of open models on Vercel AI Gateway: 🟦 Open 78.4% 🟨 Closed 21.6% While spend 💲 usually tells a different story, #3 and #4 today are Moonshot AI & DeepSeek. Adding Z⁠.ai, their combined spend surpasses OpenAI (#2). (Do note that's the spend for inference of the model across providers (mostly in the US), not revenue going directly to the open weight labs.)

I am done with this shit. It is over. The state of engineering right now is horrible. It has been half a month since I started a new role at a big company. Nobody knows anything here. The specs, code, tests, PRDs, tickets, resolution of those tickets, reports, etc., everything is made by Claude Code. Nobody on my team likes this. They are being forced to ship as much as they can. I have heard multiple times from higher management that pushing code is not a bottleneck, so why are we slow? People are working 12 to 13 hours a day just to press enter. Nobody is reading anything. Humans in corporate are doing nothing on their own. Everyone, literally everyone, from an L1 to an L7 engineer here is doing the same thing. Talk to Claude. There is no sense of victory. Nobody is resolving bugs. In reality, nobody is thinking anymore. Everything is done by LLMs. It is so soul-sucking. I would not mind it, to be honest, if we were at least given the time to check out the code and see what is going where. But no, the goal is to just ship. No matter what happens.

Tomorrow: HKPUG #101. 🔎 Whoosh3 + BM25 + Python scoring ⚙️ tinygrad GPU programming workshop 🏆 Opik Challenge award Basic Python. Ordinary laptop. Bring your charger. 19 Sep · 15:00–18:00 · CityU (room TBC) Attend + form: meetup.com/pythonhk/events/3… #HKPUG

We now have the fastest Llama 8B train on AMD MI350X in the world, and it was run on a machine that was thermal throttling! (we don't have AC, only fans) tinygrad gets 108.5 minutes, top MLPerf time is 108.9 minutes.

this is Dario and sama's worst nightmare - A law firm buying Nvidia servers. Latham & Watkins is building an in-house AI stack.. this is US’s second-largest law firm with $8.3 Billion in revenue last year And now it has - - Nvidia hardware it controls - open-weight models it can fine tune - proprietary legal data it is trusted to protect - infrastructure only Latham employees can access A law firm has decades of contracts, negotiations, client context, legal reasoning, and institutional knowledge. They dont want to give all of that away to OpenAI or Anthropic in exchange for expensive tokens.. And on top of that - risk their data being used to train frontier models.. This will happen more and more now.. The big AI labs have no moat.. nothing protecting their largest customers from moving on.. The biggest companies in the world will - - own the compute - own the data - own the workflow - fine tune the model around their business - switch providers when the pricing or quality changes Dario and sama want to make this illegal by bringing in regulation.. and become the AI overlords..

This very much sounds like a West-only AI cartel proposal and, in fact, if you read Dario's essay - under the very telling "pacing within democracies" chapter - he specifically says he'd need the US government to issue an "antitrust waiver" for this. The plan transparently looks like this: agree among themselves not to compete too hard, get an antitrust waiver to make it legal, and while they're at it, get Washington - under the veneer of "safety" - to kneecap Chinese competitors because only "democratic" models can be in this "safe pacing" club. I'm not even exaggerating: Dario pretty much writes this explicitly. There are 3 steps to his plan and step 2 is literally: "Frontier AI companies within democratic countries coordinate to establish common safety standards as well as limits on the rate of unchecked AI progress" -> the "unchecked AI progress" that would need "limits" is simply AI progress that happens outside their agreement. Another word for it is simply competition 🤷‍♂️ He also explicitly writes that "a key part of pacing within democracies is to keep democracies’ AI lead over autocracies as large as possible." You can't possibly be clearer than this...