I think I may have just figured out a new model architecture from first principles. Seems promising in initial tests.
Internal reasoning, small models (magnitude smaller)
Going to be calling this RouterLM.
Whoever wants to participate/share ideas my DMs are open. Don't expect too much intelligence from me. Trying to figure this shit out too..