Several articles & resources I’ve been reading lately to learn about how LLM architectures have evolved: * finbarr.ca/five-years-of-gpt… 5 years of GPT-class model progress, only goes to 2023 but that puts more focus on early models where details are precisely known * magazine.sebastianraschka.co… great companion post to the first one as its diagrams and code examples are absurdly helpful. @rasbt has so many articles that could be on this list but I picked this one because of the visuals in particular * gregorygundersen.com/blog/20… denser than other posts. my attention can glaze over some of the deeper math formulas but as a synthesis of key LLM concepts have evolved this is excellent * cameronrwolfe.substack.com/p… both accessible in the basics "what is a token?" and detailed, this one goes into other notable models from early LLM days (post image is from this article)