I write code that works, sometimes. runtime @modal
- Tweets 3,244
- Following 287
- Followers 3,232
- Likes 4,845
FYI
The secret to Modal's speed is our custom lazily loaded container filesystem, ImageFS. ImageFS is built on a massive tiered distributed filesystem, layering local NVMe disks, regional and p2p caches, and global blob stores.
When we launched VM Sandboxes this month, we wanted to make sure they could take advantage of ImageFS in the same way our gVisor containers do. To do that, we built out a new filesystem stack that tricks a VM's ext4 driver into thinking it's talking to a normal disk.
1
2
50
2,936
If you wanna do cool things with BPF, Linux kernel, and/or networking I got a guy, at a place
(im the guy, modal.jobs is the place)
Scaling compute across global sites requires precise, process-level network attribution.
In our latest post, Eric breaks down how we combined Linux eBPF kernel tracing, service logs, and hardware counters to map every byte back to the right workflow.
Read on HRT Beat: hudsonrivertrading.com/hrtbe…
12
12
404
27,147
I'm not exaggerating in the slightest when I say we're doing some of the coolest systems work out there. There's more where this came from:
The secret to Modal's speed is our custom lazily loaded container filesystem, ImageFS. ImageFS is built on a massive tiered distributed filesystem, layering local NVMe disks, regional and p2p caches, and global blob stores.
When we launched VM Sandboxes this month, we wanted to make sure they could take advantage of ImageFS in the same way our gVisor containers do. To do that, we built out a new filesystem stack that tricks a VM's ext4 driver into thinking it's talking to a normal disk.
2
386
The secret to Modal's speed is our custom lazily loaded container filesystem, ImageFS. ImageFS is built on a massive tiered distributed filesystem, layering local NVMe disks, regional and p2p caches, and global blob stores.
When we launched VM Sandboxes this month, we wanted to make sure they could take advantage of ImageFS in the same way our gVisor containers do. To do that, we built out a new filesystem stack that tricks a VM's ext4 driver into thinking it's talking to a normal disk.
13
30
543
52,153
Our original (naive) implementation of this -- simply sharing ImageFS to a guest VM -- totally blew up our performance. If you know anything about Modal, this was unacceptable.
By rethinking ImageFS in blocks we went two orders of magnitude faster, making for an ultra-fast backbone for our VM Sandboxes.
1
32
4,423
Read about our work and thought process: modal.com/blog/vm-sandbox-fi…
2
35
3,248
New goal: one concurrent sandbox for every dollar we raise
Who’s in?
Today we're announcing that Modal has crossed $1B in annualized run rate, as well as raised a $750M Series D at a $15.75B valuation, led by @Accel.
Since our Series C, usage has tripled and we’ve grown more than 15x year-over-year.
We are deeply grateful to the developers and companies building on Modal. There's still so much more to build, and we can't think of a better time to be building software.
1
37
1,368
can't get enough of these visuals 🤤
Training large models with RL typically runs on a fixed homogeneous cluster of the latest accelerators for numerical stability and faster throughput. This throws away inference optimization work done for other vendors and generations, limits the capacity you can utilize, and is unnecessarily expensive.
So we trained a model on agentic coding tasks using fully asynchronous RL and mixed-precision, mixed-accelerator samplers. With off-policy correction, training stayed stable through convergence, on par with homogeneous samplers, at a lower cost.
1
1
23
1,022
The best infra is infra you don't think about. VMs for Sandboxes helps immensely with this.
Looking forward to sharing some eng deep dives on the cool tech that the runtime team is 🍳 up
VM Sandboxes give your agents access to a full Linux kernel.
Reach for VMs when your agents reach the limits of limits of user space: working with Docker, FUSE filesystems, and certain Linux kernel features.
modal.com/blog/vm-sandboxes-…
37
2,538
