If we assume Astra's arch is like the Full-bandwidth transformer or Recurrent Looped Transformer, and that the model is larger than Sol,
could Astra-*minor* be the size of Sol, but with recurrence? if so, the benchmarks could show how much sequence-level recurrence in a Transformer buys 👀
I decided against writing an article and revealing how I come to these new estimates. I want to do more analysis on the coming models.
my latest central estimate is that GPT-6 Astra is:
- 4.2T@120B
- around 112 layers
- loops 50% of its layers once
I also have evidence that GPT-6 Sol and Luna, and Opus 5.5 are NOT looped language models.
The leaks about "Astra Minor" suggest a smaller Sol sized looped model coming, that probably slides right into the $20-25 price point.