10 trillion params from bytedance. the scaling wars aren't over, they just moved to whoever holds the power contracts. model size is downstream of energy now
ByteDance is training an AI model that could approach the size of Anthropic’s Mythos system
Its training a model with as many as 10tn parameters, three times larger than Moonshot’s Kimi K3.
1. Because several reputable sources now confirm it, it can be assumed that it's true and that they are indeed training a 10b parameter model.
2. This makes it even less likely that the US labs will slow down.