🚨
$TAO SN9
@IOTA_SN9 On Monday alone added:
8x L40S from Tokyo
16x A100 from Calgary
14x A6000 from Las Vegas
8x A100 from Kansas
4x A100 from Helsinki
RTX 4090s, RTX 5090s, A100s, A6000s, L40S, all mixed together, all contributing. Top node locations right now are Barrow-in-Furness UK (76), Norwich UK (64), Hong Kong (24), Las Vegas (14), with more spread across Houston, Denver, Calgary, Helsinki and more......
And that mixed hardware is now helping train Orion-16B, a 16.2B parameter model running across 226 active nodes, 12 locations and 3 continents.
Live numbers:
130.18B tokens processed
97.1K tokens/sec
21.38% MFU
Loss down to 3.1624
The important part is not the model.
It is the idea SN9 is testing:
Does large-scale training really need one perfect cluster of identical GPUs?
IOTA, no, no, no....
If a device can hold roughly 10% of the model weights, it can contribute.
Instead of forcing the world to build around a few premium datacenters, IOTA will make the compute already spread across the world useful for training.
And unlike a lab, the network is visible:
260 miner nodes
11,413 routing paths
individual hotkeys
live throughput
public leaderboard
If this keeps scaling, SN9 is not just building decentralized compute.
It is attacking one of AI training’s biggest problems and its working.
The Supercomputer subnet.
$TAO | SN9 | DYOR.