Meta being back in the open weights game is a very big deal. There have been 3 major training (SFT/RL) periods since the ChatGPT moment:
1. 2023 when the closed models weren't good enough for many use-cases and weren't enterprise ready (ZDR, security, latency, hyperscaler support). AlphaSense was big on fine-tuning (including on Llama 2/3) in this period and it helped us launch features like Smart Summaries at sufficient reliability. But as closed models accelerated (Sonnet 3.7, GPT-4o and especially reasoning models like o1) the market including AlphaSense re-focused around the labs to power features like Generative Search and Deep Research (still maintained custom models for narrower data processing and ranking use-cases).
2. 2025 when the labs released their fine-tuning endpoints and a number of startups hyped these offerings. This was always a flash-in-the-pan and we didn't take it seriously.
3. Right now. The ecosystem around training is fully here with data generation, RL infra and American open weights models all feeding off each other. Once again at AlphaSense, we see a massive opportunity to increase the quality, reliability and efficiency of our AI offerings by training custom models. In particular we are very focused on models for Search - specifically context collection across our qualitative and quantitative tools and data which continues to be the biggest bottleneck and opportunity for progress in AI in Finance.
Today we're also opening the weights for Muse Glimmer, a great 30B parameter dense model that can run locally. Soon we'll also release the weights for Muse Spark 1.2, our latest foundation model. Meta is a strong supporter of open source and I'm proud of these releases. Congrats to
@alexandr_wang and the MSL team for all your great work on these models.