co-founded @parsedlabs before we started hill sprinting @baselabs @baseten, half eng/cs phd @rhodes_trust @UniofOxford

SF
It has been easy to back the open source narrative recently with so much exciting progress, but the cyclical swings in energy we have seen seem inevitable. Inspired by the great scientists (including LeBron) pictured in video, @baselabs is a very direct effort to pursue a long-term research agenda that aims to support the WHOLE ecosystem (that we see being a mix between closed and open source models) for the long run. It is backed by @baseten ripping (which has a little more $$ than academia), but has a clear mandate to publish without exception and encourage skepticism. Our manifesto mentions 'Science done behind closed doors is worse science. It cuts off the one mechanism that has ever made knowledge reliable: correction from the outside'. Here's to democratising intelligence!
Today we're announcing Base Labs, a dedicated research organization focused on advancing open-source AI. We believe in a healthy, open frontier model ecosystem. To enable this, we are working on: - Blue-sky research on continual learning, the science of RL, and how models learn across their full lifecycle, with every experiment and recipe shared openly. - The BaseHub Data Foundry: the highest-quality open RL environments, training data, and real-world benchmarks, built for anyone to train and benchmark on. - Post-post training: taking open-source models and making them better, safer, and more aligned through continual post-training, built on our research, and deployed with our frontier safety stack so organizations can use open-source models with confidence. - Making models cheaper and more performant through our model performance research. This is a mission-driven research effort, not a commercial product. We believe the health of the open-source AI ecosystem matters and that the best way to advance it is to do science in the open. We’re hiring engineers, researchers, and research fellows to advance this mission. labs.baseten.co/
12
9
71
6,050
Mudith Jayasekara retweeted
LangSmith Fine-Tuning 🚀 launched in partnership with our friends @baseten and @FireworksAI_HQ - try it out 🤝 one of AI’s most interesting & difficult problems today is a Data Problem turning raw trajectories into Environments & curated trajectories to improve your agents the goal of LangChain Labs is to help every team continuously turn their valuable trace data into better agents via Post-Training & Harness Eng - trajectories help teams understand agent behavior at scale - but preparing and mining raw data is really hard today, agents are not good at data curation today - we want to help you drive this end to end flow from raw data to better agent with post-training reach out if this is interesting and try it out 🫡
Introducing LangSmith Fine-Tuning and the smithtune CLI. LangSmith now handles the entire fine-tuning process. Use your traces to train specialized models that cut cost and latency. Now in Public Beta. langchain.com/blog/langsmith…
9
7
68
8,366
Stoked to support traces to trained model work with friends at @LangChain! There are many open questions we are exploring on how we can continue to improve the (semi) automated env creation for RL in a way that is actually useful for downstream task. More to come!
Stoked to launch 𝚜𝚖𝚒𝚝𝚑𝚝𝚞𝚗𝚎 in public beta! Post-training your agent's policy has never been easier, with training APIs from @baseten and @FireworksAI_HQ becoming increasingly accessible. But sourcing high-quality data to use them effectively remains a challenge. LangSmith processes hundreds of millions of traces a day, making it a rich system of record for your agent’s behavior. 𝚜𝚖𝚒𝚝𝚑𝚝𝚞𝚗𝚎 turns those trajectories into the data you need for supervised fine-tuning, with an end-to-end pipeline for curation, preparation, training and deployment for models you want to SFT for specific tasks. We care deeply about giving teams ways to own their own intelligence, and as the open model frontier continues to advance, it’s becoming increasingly clear that post-training on your own agent data will become a key part of that. Excited to get this into people's hands!
7
463
Mudith Jayasekara retweeted
Distillation is a common way to prepare a model for RL where learning occurs from a stronger model, and then improves through trial and error. But how much does that better starting point help after RL? We conduct preliminary research on this question across model sizes and reasoning tasks. 🧵
9
23
257
47,549
We're working towards the open intelligence safety stack! We've always been interested in making models do 'real' work. But we've also been very interested  in making sure they are safe and aligned (before it was cool). This started for us with mech interp at @parsedlabs, and now continues at @baseten which serves so much of the world's traffic. The responsibility definitely lies both on the closed and open labs to help shape this work. Excited to partner with @Thom_Wolf @ClementDelangue @julien_c + team from @huggingface and @eric_ho @banburismus_ + team from @GoodfireAI. We'll be publishing our safety research in the open and are aiming to build as much of it as possible into our serving stack. To start, this will include alignment training, monitoring in prod, and interventions shaped from these detected failures. A big ecosystem effort!
We believe openness to be an advantage for AI safety. Openness provides more visibility into the behavior of models and, most importantly, greater means of turning safety research into actionable and transparent controls than closed-source. This is why Baseten and Base Labs are building a stronger safety and security standard for open models, with the launch of our safety infrastructure. Base Labs will develop and publish methods for training and monitoring open models, and Baseten will integrate that work into its deployment infrastructure, live at runtime, and offer this work as a managed service. This will be a standard that is transparent and built into how our models are trained and deployed. We invite the open-source community to contribute, and are proud to partner with @huggingface and @GoodfireAI to bring this vision to fruition. Together, we are building an ecosystem of open models that are safe and accessible to all.
2
5
50
2,605
Mudith Jayasekara retweeted
Safety is not just for closed models. The closed frontier labs are a canary in the coal mine for what is coming at scale. They give us a glimpse into the future and a window to harden our systems and prepare for abundant intelligence, with all the risks that come along with it. The OpenAI agent swarm attack on Hugging Face is the kind of failure we need to prepare for as open-source models catch up. The providers serving those models (such as Baseten) have a big role in establishing what safety and monitoring standards look like. We’re proud to be taking the lead on this at @baselabs with our collaborators @huggingface and @GoodfireAI. We’re developing safety research in the open and building it directly into Baseten’s inference infrastructure, with the aim of making it available to all our customers. This includes training models to follow explicit policies, detecting failures at runtime, and connecting those signals to controls that can intervene. We invite others in the open-source ecosystem to join us in building the tools and standards we’ll all need.
We believe openness to be an advantage for AI safety. Openness provides more visibility into the behavior of models and, most importantly, greater means of turning safety research into actionable and transparent controls than closed-source. This is why Baseten and Base Labs are building a stronger safety and security standard for open models, with the launch of our safety infrastructure. Base Labs will develop and publish methods for training and monitoring open models, and Baseten will integrate that work into its deployment infrastructure, live at runtime, and offer this work as a managed service. This will be a standard that is transparent and built into how our models are trained and deployed. We invite the open-source community to contribute, and are proud to partner with @huggingface and @GoodfireAI to bring this vision to fruition. Together, we are building an ecosystem of open models that are safe and accessible to all.
4
14
131
29,728
Mudith Jayasekara retweeted
The future is about continuously turning your valuable data & ideas into better/faster/cheaper models -> Owning your Intelligence the Baseten team rocks at helping us run tons of experiments to make this happen @AEllisBloor @mudithj 🤝 A lot of work in our Labs team looks like: - sitting down with a buddy @jakebroekhuizen - picking a problem/agent to make better, cheaper, faster - curating data + evals/environments - doing tons of training experiments, with continuous measurement of every tweak - Loop (pun intended) the infrastructure and tooling is here to allow every team to run hundreds of experiments and get the best quality/cost/latency tradeoff for their customers and use-cases also ngl training is fun and your agents will love the experience
3
5
38
6,417
Mudith Jayasekara retweeted
A flavour of our research interests on the Dwarkesh Podcast this week, discussed by our very own @oneill_c. Just the start of a longer conversation about long-horizon RL and frontier open-source training here at Base Labs.
New episode with @johnschulman2, @oneill_c and @BerenMillidge. I got together with some of the most insightful AI researchers I know who are at the openish companies, because I wanted to hear the details of what's actually happening at the frontier and what comes next. 0:00:00 – Steelmanning the case against RSI 0:18:39 – What’s driving the Chinese labs’ progress 0:28:06 – How will automated AI researchers be trained 0:33:51 – Will long-horizon RL elicit AGI? 0:45:24 – The sim-to-real gap 1:00:33 – How much progress is explained by data? 1:18:03 – Why is RL working so well? 1:24:54 – Move 37 and entropy collapse 1:28:31 – Rapid-fire timelines
1
3
24
3,780
Mudith Jayasekara retweeted
I think one of the more interesting things we debated here is whether RSI is a cumulative task. Attention plus MoE plus GRPO etc seems to me like a line in the sand that you can just add to the stack once you discover it. You don't need to take five steps back to take 10 steps forward. But a lot of the work in the world isn't this clean and it certainly isn't this stationary eg legal work. This leads to some perhaps unintuitive predictions such as why RSI might land before continual learning (and why it's going to be hard to get off the current paradigm even if it's wrong) Thanks for having me @dwarkesh_sp!
New episode with @johnschulman2, @oneill_c and @BerenMillidge. I got together with some of the most insightful AI researchers I know who are at the openish companies, because I wanted to hear the details of what's actually happening at the frontier and what comes next. 0:00:00 – Steelmanning the case against RSI 0:18:39 – What’s driving the Chinese labs’ progress 0:28:06 – How will automated AI researchers be trained 0:33:51 – Will long-horizon RL elicit AGI? 0:45:24 – The sim-to-real gap 1:00:33 – How much progress is explained by data? 1:18:03 – Why is RL working so well? 1:24:54 – Move 37 and entropy collapse 1:28:31 – Rapid-fire timelines
11
15
161
27,968
Mudith Jayasekara retweeted
Awesome work by @nikogrupen @ItsJulioPereyra and team with @baseten. Together with @baselabs, we built a recursive language model (RLM) harness that lets a root agent delegate document review to sub-agents and combine their findings into a diligence memo. Post-training Qwen 3.5 in this RLM harness more than doubled rubric pass rate on LAB Diligence tasks, from 29.9% to 63.0%, and increased review coverage from 62% to 96% of all documents in a dataroom. We’re also doing an RL scale up run with GLM-5.3 and will share the results soon and believe model-harness co-optimization is a viable path to automating end-to-end legal tasks like M&A diligence.
9
9
94
12,697
This is how we support a bunch of neolabs training frontier models (some of which we should be able to talk about in public soon when they release their models). Pretty neat trick @part_harry_ and @stefanopopoulos cooked up reading the compressed block directly rather than scanning every byte.
2
1
25
1,483
Excited about this RLM work as it shows: (i) Clear benefits of harness design that solves for the particular constraints of the task (every model showed significant uplift with an RLM harness). RLMs here solve for the 80M tokens sometimes required to be traversed per task (ii) RL works and the recipe can translate (with some careful monitoring). We RL'd smaller models like Qwen 122ba10b and larger ones like GLM 5.3 (iii) RL shapes useful behaviours even when not directly rewarded. In this case, dataroom coverage went from 62% to 96% which intuitively is the right behaviour being learned. We're just getting started etc. etc. @nikogrupen @gabepereyra @ItsJulioPereyra @winstonweinberg and broader research team are cranking.
We partnered with @baseten to post-train recursive language model (RLM) agents for M&A diligence. We found that model-harness co-optimization meaningfully improves agent performance in long-horizon environments, bringing us closer to agents that can complete M&A diligence end-to-end. We started by building an RLM harness that lets a root agent search a data room, delegate document review to sub-agents, and orchestrate the sub-agents' work to produce a final diligence memo. By distributing document review across sub-agents, the RLM harness can work through thousands of documents in data rooms containing up to 80M tokens. On LAB Diligence, our synthetic M&A diligence benchmark, the RLM harness raised average rubric criteria pass rate across models from 23% to 62%. Despite the root agent processing just 1-4% of the tokens in diligence (with sub-agents processing 96-99%), the choice of root agent had a much larger effect on performance than choice of sub-agents. This led us to focus on the root agent, training two models separately to improve diligence performance. First, we trained a GLM-5.2 root model in the RLM harness using self-distillation SFT. We selected GLM-5.2 diligence runs with high data room coverage and fine-tuned the model on these trajectories. This increased benchmark performance from 46% to 60%. Second, we trained a base Qwen3.5-122B-A10B using GRPO within the RLM harness, keeping the sub-agent models fixed. This raised rubric criteria pass rate from 30% to 63% on 50 held-out data rooms. In both cases we saw major qualitative shifts in agent behavior. The trained root agent learned to delegate more thoroughly and write its memo incrementally as sub-agent findings came back. Data room coverage rose from 62% to 96%. And the root agent learned to scale the size of its agent team proportionally to the size of the data room. We are now scaling RL training with GLM-5.3, a frontier open-weight model, as the root agent. A small amount of training gives an increase in pass rate from 51% to 59%. @nikogrupen walks through these experiments with more on harness design, training setup and results, and what we're exploring next:
2
29
2,131
Mudith Jayasekara retweeted
there are few research blogs worth reading and parsed.com is one of them
Today we're launching Base Labs, a research lab by Baseten. Our mandate is to make open-source as useful as possible, and our one rule is that we publish without exception, including what fails. Up until pretty recently I thought the way to get the world onto open models was to train them for one company at a time. @mudithj, @maxkirkby and I cofounded @parsedlabs on that bet, @baseten acquired us, and we spent the last year running their training team doing it for customers one by one. Every one of those engagements taught us something new about how models learn, forget, specialise and get cheaper, and almost none of it got spoken about. Sadly, in general that's the field's default in that the people who know the most about training have the least freedom to say it. To be clear I don't think the closed labs are the villains here. They get to new capabilities first, which buys the rest of us time to harden the world before that stuff is everywhere, and they're the ones paying to find out what's actually possible. But I'm fairly convinced the only real advantage they have is data and scale, and their incentives point squarely at the frontier. You can't do slow, public science on how these things learn when your job is the best model by end of quarter. Someone without that pressure has to, and there are very few of those someones around. Hence Base Labs. We have the broad remit of making open-source as useful as possible and our one rule is that we publish without exception, including what fails. The first problem is continual learning, which I have come to think is several problems wearing one name. We are also working on the open RL environments and data that open models need and currently can't get, because we have to aggregate data with the same ferocity everyone's been talking about aggregating compute. Plus a bunch of other stuff I'm genuinely excited about, eg a safety stack people can run on top of open deployments, and performance research so these things are cheap for everyone to serve. I still think open and closed coexist, and that's the good world. It's just that coexistence isn't free, someone has to actually do the work, and this is basically what keeps me up at night. We're hiring researchers, engineers and fellows. Come help distribute the mandate of heaven!
2
9
136
18,756
Mudith Jayasekara retweeted
Today we're launching Base Labs, a research lab by Baseten. Our mandate is to make open-source as useful as possible, and our one rule is that we publish without exception, including what fails. Up until pretty recently I thought the way to get the world onto open models was to train them for one company at a time. @mudithj, @maxkirkby and I cofounded @parsedlabs on that bet, @baseten acquired us, and we spent the last year running their training team doing it for customers one by one. Every one of those engagements taught us something new about how models learn, forget, specialise and get cheaper, and almost none of it got spoken about. Sadly, in general that's the field's default in that the people who know the most about training have the least freedom to say it. To be clear I don't think the closed labs are the villains here. They get to new capabilities first, which buys the rest of us time to harden the world before that stuff is everywhere, and they're the ones paying to find out what's actually possible. But I'm fairly convinced the only real advantage they have is data and scale, and their incentives point squarely at the frontier. You can't do slow, public science on how these things learn when your job is the best model by end of quarter. Someone without that pressure has to, and there are very few of those someones around. Hence Base Labs. We have the broad remit of making open-source as useful as possible and our one rule is that we publish without exception, including what fails. The first problem is continual learning, which I have come to think is several problems wearing one name. We are also working on the open RL environments and data that open models need and currently can't get, because we have to aggregate data with the same ferocity everyone's been talking about aggregating compute. Plus a bunch of other stuff I'm genuinely excited about, eg a safety stack people can run on top of open deployments, and performance research so these things are cheap for everyone to serve. I still think open and closed coexist, and that's the good world. It's just that coexistence isn't free, someone has to actually do the work, and this is basically what keeps me up at night. We're hiring researchers, engineers and fellows. Come help distribute the mandate of heaven!
Today we're announcing Base Labs, a dedicated research organization focused on advancing open-source AI. We believe in a healthy, open frontier model ecosystem. To enable this, we are working on: - Blue-sky research on continual learning, the science of RL, and how models learn across their full lifecycle, with every experiment and recipe shared openly. - The BaseHub Data Foundry: the highest-quality open RL environments, training data, and real-world benchmarks, built for anyone to train and benchmark on. - Post-post training: taking open-source models and making them better, safer, and more aligned through continual post-training, built on our research, and deployed with our frontier safety stack so organizations can use open-source models with confidence. - Making models cheaper and more performant through our model performance research. This is a mission-driven research effort, not a commercial product. We believe the health of the open-source AI ecosystem matters and that the best way to advance it is to do science in the open. We’re hiring engineers, researchers, and research fellows to advance this mission. labs.baseten.co/
67
64
927
120,912
Mudith Jayasekara retweeted
Baseten Head of AI Model Training @oneill_c says the future is many specialized LLMs dedicated to specific tasks, with bigger labs deployed on the frontiers of areas like science and math: "People are thinking about intelligence capabilities in the wrong way. People are thinking about intelligence relativistically. They say, 'OK, the open-source gap is like 6 months behind closed-source, and GLM 5.3 is as good as Opus 4.8,' or whatever." "The best way to think about what models can do for you, and for the world, is in an absolute sense." "So for any given task that you want to do with an LLM, there's some intelligence threshold where below that you can't do the task, and above that you have very diminishing returns to more intelligence on the task." "So when you think about it that way, the game of LLMs over the last 5 years has been, 'OK, we have these things we want to do with them. Closed source hits it first... but open-source can eventually do that task. And then for many reasons, once you have the base level of intelligence required to do it, you probably do want to swap to open-source." "It's not really about the [frontier lab] God model being better. Like, if I'm filing a tax return, there is a limit to how much intelligence I need to do that particular thing." "So I think the world is going to look like — frontier closed-source labs are going to continue to push the frontier. You do want to use the most intelligent model. You have very inelastic demand for intelligence when you're doing frontier science or frontier math." "But for a lot of the economically valuable things, it looks a lot like, 'I'm a Cursor, or I'm one of these big companies who are realizing I can't just be a wrapper anymore. I've been through the life cycle of building a product that people love. And I should be using that information to make my model better at the things that I care about, and not at anything else.'"
5
12
142
50,767
A very exciting base to post-train given the long-context inference efficiency work in GLM 5.3! Can train on @baseten loops now + easy deploys with the baseten inference stack as always.
Post-train GLM-5.3 and GLM-5.3-Flash on Baseten Loops. Inference + training support on day 0. docs.baseten.co/loops/overvi…
1
4
39
2,344
just getting started etc. etc. @oneill_c
BaseTen is a fountain of good information, they're giving a lot and contributing to open source and research. Highly recommend spending some time reading their work if you want to level yourself up.
4
18
1,694
Mudith Jayasekara retweeted
Some questions demand the most accurate answers. @youdotcom built its Answer API to help users get grounded, cited answers to search queries in real time. We're proud to power the inference behind it, helping You.com lower costs by 30% and match closed-source frontier model accuracy with open-weight models. Full story here: baseten.co/resources/custome…
4
8
36
9,314
Long horizon legal agents à la recursive language models coming soon. This is our best (current) solve for how to effectively process 10s of millions of tokens’ worth of context in the legal domain. Don't know many other vertical AI companies moving this fast, writing this openly, and at the frontier. Big props to @gabepereyra @winstonweinberg @nikogrupen @ItsJulioPereyra and team for pushing
1
31
2,626
Mudith Jayasekara retweeted
At Baseten, we have a thesis: obsessives move the world forward. Few people embody that more completely than @bryan_johnson. On Wednesday, August 26th, we're hosting Bryan Johnson at our San Francisco office.
Made with AI
9
6
132
146,683