So Anthropic claimed it ran a 26B AI model across fifteen $55 Android TV boxes. Setup 📺 15× off-brand Android TV boxes 💾 4GB RAM each 💰 ~$55 each 🧠 Gemma4-26B-A4B ⚡ ~0.39 tok/s Total hardware cost = ~$825. The model was sharded across the boxes using pipeline parallelism, so each tiny machine only had to hold and execute part of the network. Yes, 0.39 tps is sloooooooow. But, that 26B model was actually running across a pile of cheap consumer boxes that were never designed to be AI servers. 🎯And Anthropic also said that Qwen3.5-9B agents managed to set up inference successfully on 8 of 9 hardware types they tested, including Macs, Jetsons, and RTX systems. Source: Anthropic Frontier Red Team ⚠️Note that the 15-box demo was distributed inference. The self-replication experiments in the paper were separate.

I didn't know this needs to be said but please don't take a loan to buy a gpu

Global reset landing tomorrow 10am PST for all paid ChatGPT accounts. Apologies for the slow start with GPT-6.1 Sol, it's now back to running at expected speeds after the massive load spike in the first two days.

OVH has to be hand building servers with how dogshit provisioning times are