🏗️ head of support eng. @railway | meow@ray.cat
Singapore
- Tweets 687
- Following 143
- Followers 364
- Likes 379
A community member in our Discord asked "what causes @Railway to go down". I ended up writing more than I planned. Sharing because the answer is less obvious than people think!
(Caveat: this is the high-level version. Infra failure modes as a platform are long tail and I left plenty out, but this covers the shape of it.)
3
19
4,004
Model-specific ASIC like Taalas is the way forward IMO. TPUs are still bottlenecked by its HBM for model weights. Taalas etches the model on the silicon so weights are directly fabricated into the silicon itself.
Taalas has accomplished 17k TPS on Llama 3.1 8B at ~250W power draw which is astonishing.
Imagine a future where models are cartridges you can plug-and-play like components of a Framework laptop.
OpenAI's Jalapeno chip is already performing at 2x performance.
I am very confident that we created GPUs for processing pixels concurrently as the CPU fell behind.
We are now using GPUs to handle tokens and I just dont think its sustainable. The TPU is the way forward for driving down prices.
1
561
It’s 100% a skill issue. I’ve been fully remote in globally distributed orgs for more than a decade, and I’ve built successful remote teams and processes spanning 15-hour timezones.
A good remote team ships *more* efficiently than an in-person team.
The key is autonomy, ownership, & clear written comms as defaults. Writing is also why remote orgs compound. Every decision leaves an artifact. In-person orgs evaporate their context daily.
“Remote doesn’t work” almost always decodes to “I can’t tell who’s working/what they’re working on without watching them” which is less about remote and more a confession about your org chart.
I've seen leaders shitting on remote work quite a bit lately.
I can confidently say it's a skill issue x100
Remote work isn't perfect but neither is in person. A good remote team can ship just as efficiently as a good in person team.
It is harder to build a good remote team though as most people don't have self management experience.
Build a team of high ownership people and you won't lose.
1
28
3,279
@ElectricSQL + @tan_stack DB seems to be the most plug-and-play solution I've seen that doesn't require a major re-architecture.
2
69
Wanna kill a SaaS you’re using? 👇🏻dev.new
1
7
3,532
