AI infrastructure that developers love 💚 Run inference, sandboxes, batch processing, training, and many other things on Modal

New York City
Pinned Tweet
Registration is live for Runtime. Apply to attend our inaugural conference for engineers running AI in production. October 1st live at The Midway in San Francisco.
11
25
134
32,156
Modal retweeted
Excited to be speaking at Modal Runtime alongside an insanely stacked group of speakers! Will be talking about how we're making agents on niteshift.dev faster, cheaper, and more reliable using @modal!
The full Runtime agenda is live, including talks from: @ScottWu46, Co-founder & CEO @cognition @CompleteSkeptic, Co-founder & CEO @typesafeai @dylan522p, Founder & CEO @SemiAnalysis_ @sarahookr, Co-founder & CEO @adaptionlabs @ajratner, Co-founder & CEO @SnorkelAI
1
6
44
4,106
One week until Runtime.
4
6
43
5,054
Modal retweeted
. @modal moves mountains to make models manifest! Our man in pink @CompleteSkeptic will be speaking at Runtime, you won't want to miss it.
The full Runtime agenda is live, including talks from: @ScottWu46, Co-founder & CEO @cognition @CompleteSkeptic, Co-founder & CEO @typesafeai @dylan522p, Founder & CEO @SemiAnalysis_ @sarahookr, Co-founder & CEO @adaptionlabs @ajratner, Co-founder & CEO @SnorkelAI
12
11
182
50,655
The full Runtime agenda is live, including talks from: @ScottWu46, Co-founder & CEO @cognition @CompleteSkeptic, Co-founder & CEO @typesafeai @dylan522p, Founder & CEO @SemiAnalysis_ @sarahookr, Co-founder & CEO @adaptionlabs @ajratner, Co-founder & CEO @SnorkelAI
9
20
174
64,360
Modal retweeted
modal x neo next week @ runtime
@BerntBornich, founder and CEO of @1x_tech, is joining us at Runtime. His deep expertise in machine learning and autonomous systems, combined with a strong user-centered design philosophy, has shaped everything, from early prototypes to the NEO Home Robot. He'll talk through the making of NEO and his bet on a more abundant, human-centered future.
4
7
48
6,873
@BerntBornich, founder and CEO of @1x_tech, is joining us at Runtime. His deep expertise in machine learning and autonomous systems, combined with a strong user-centered design philosophy, has shaped everything, from early prototypes to the NEO Home Robot. He'll talk through the making of NEO and his bet on a more abundant, human-centered future.
6
5
35
6,581
Join Diogo Almeida (@CompleteSkeptic), Co-founder and CEO of @typesafeai at Runtime on October 1st.
11
6
160
23,826
100% @modal 👑 arming the jevolution with GPUs. Y'all have been the best this week.
If you’re wondering how Jev is scaling to meet insane demand they could not possibly have predicted, the answer appears to be @modal — one of only 4 subprocessors listed on trust.typesafe.ai
2
22
153
36,658
Modal retweeted
If you’re wondering how Jev is scaling to meet insane demand they could not possibly have predicted, the answer appears to be @modal — one of only 4 subprocessors listed on trust.typesafe.ai
Jev was adopted faster than any other model in AI Gateway history. In the first day, @typesafeai reached ~13% of teams, 2x the GPT-5.6 family and 6x Fable 5.1.
6
22
227
94,598
We've partnered with Anthropic to contribute up to $250K in Modal credits for researchers pushing protein design forward in the open 🧬
Replying to @AnthropicAI
To show what these optimizations make possible, we’re partnering with Adaptyv Bio on a protein design competition. Together, we’ll be experimentally validating over 5,000 designs. We're providing up to $1 million in Claude credits plus funding alongside Adaptyv for experimental validation. Modal is contributing up to $250,000 in compute and Twist Bioscience is providing DNA. Learn more on Adaptyv’s Proteinbase: proteinbase.com/competitions… And sign up for the competition here: docs.google.com/forms/d/e/1F…
11
20
225
20,992
come to modal.com/runtime to see something cool here
This evening I went to Envelop SF. It’s a listening space for ~15 people, with 32 big speakers all around you. It was so cool to experience a great album immersively like this, in the highest possible quality, with the sound moving all around you. If you like music, check it out!
3
10
2,049
So much of our alpha is in the infra layer anyway. So we’d rather work with open source projects and contribute back. Thanks @sgl_project for building amazing stuff!
which of your favorite token brokers are contributing back to open source ai? shall we count the ways? a slice of data: number of PRs upstreamed and merged into the most popular oss inference engines, by PR contributor org
2
11
115
18,777
I connected devin to some @modal H100s and then left it alone to run its own experiment loop against the GPUs. it found a way to reduce peak memory by up to 46% and latency by up to 52% on a popular OS training-kernel repo. since the triton kernel was already near peak HBM bandwidth, it focused on other things, removing a 2GB allocation that was happening on every chunk of the backward pass. then it ran the benchmarks to confirm the speedup 🤯
4
8
72
6,768
Runtime speaker lineup is live! We're bringing together experts covering AI infrastructure, applications of AI in science and robotics, the future of software engineering, and more.
17
48
141
61,405
Register to join us on October 1st at The Midway. modal.com/runtime
2
2
13
2,948
Frontier models are simply too expensive and slow for the majority of use cases, so we see models like SWE-2 becoming the daily driver for most. Training trillion-parameter coding agents at scale isn't easy though: typically, each step launches thousands of rollouts, each with its own isolated environment. Cognition uses Modal's sandbox infrastructure for the rollouts behind SWE-2. Congrats on the launch! More on how we scale Sandboxes: modal.com/blog/scaling-to-1-…
Introducing SWE-2, our closest model yet to the frontier. On leading evals, it scores on par with recent frontier models – at up to 70% lower cost. We scaled RL to multiple trillions of parameters, with a refined recipe that pushes the Pareto curve on both capabilities & cost.
28
20
464
48,260
Run your agent on OpenAI. Run compute on Modal with isolated, secure sandboxes.
Replying to @OpenAIDevs
Your sandbox, your call. Bring your own sandbox or connect a sandbox provider. Choose the environment that fits your workload: • CPU, GPU, and memory options • Fully managed environments or deployments within your VPC • File and secret storage options We offer first-class integrations with @blaxelAI, @CloudflareDev, @daytonaio, @digitalocean, @e2b, @modal, @OracleCloud, @RunloopAI, and @vercel.
7
7
52
8,269