AI Infra @ Microsoft Formerly: Modular, Microsoft AI Frameworks, Google (TensorFlow), Strava, Rdio, Songbird

Minneapolis / St. Paul
I've been hacking on a notebook using @observablehq and @d3js_org to visualize a @TensorFlow.js deep-neural network during training. This demo trains a model to call a virtual strike zone based on MLBAM PITCHf/x data: beta.observablehq.com/@nkree… ** Not supported on mobile devices
3
24
79
To take a step back, I really miss the days where we've been able to take our time to design software that's going to last because we knew what's going to last. It's not the case in this domain and we are all sloppy. Do I love it? No. Is it ok? Sure, we are going to rewrite.
5
3
163
9,372
Nick Kreeger retweeted
Int4 and Int6 is a great way to reach new levels of efficiency and latency for big LLMs - particularly on CPU. MAX makes is super easy to adopt and move GenAI models to these formats. I'm very excited about this release - and yes, MAX for NVIDIA GPUs is coming later in summer!
📣 MAX 24.4 ⚡️ is here! Featuring: ⚛️ New quantization APIs, with SOTA CPU performance for LLMs! 🍎 MAX for macOS! 🦙 INT4 implementation of Llama3/2! ➕ Performance and standard library improvements for Mojo 🔥, including 200+ community contributions. modular.com/blog/max-24-4-in…
1
14
172
41,346
Nick Kreeger retweeted
Beyond a huge step for open source, @Modular released MAX 24.2: a tremendous step forward in Mojo🔥 (implicit trait conformance, python kwargs support, nightly builds!), even better PyTorch dynamic shapes + performance, and more. Check it out, the team is on fire! 🔥❤️‍🔥🏎
Replying to @Modular
⚡️ What's new in MAX 24.2? This latest release ships with new features and improvements to MAX Engine 🏎️ and Mojo 🔥, including the latest evolution of the Mojo 🔥 language. Check out all the updates! ⬇️ modular.com/blog/max-24-2-is…
2
10
79
12,865
Nick Kreeger retweeted
A big step forward for Mojo - it's not just open source, but open development and contribution model with a progressive Apache2 LLVM license. 🏆 We ❤️‍🔥 the Mojo community and are thrilled to continuously open the language and its development as little Mojo is growing up!
👩‍💻 We're excited to announce that we've open sourced the Mojo 🔥standard library! 📚 Building Mojo🔥 in the open will lead to a better result and open sourcing the standard library is our next step in the journey. 🚀 We're also dropping MAX 24.2 today! modular.com/blog/the-next-bi…
15
66
476
57,759
Nick Kreeger retweeted
Excited to be a top company on @FastCompany most innovative AI companies list 🔥 Huge thanks to our incredible community, partners, team and investors! 🙏🏼 We're working hard to push the boundaries everyday, to rebuild AI infrastructure for the world 🌍🚀 fastcompany.com/91029555/art…
2
6
25
8,562
Nick Kreeger retweeted
🚨📢 MAX Developer Edition Preview has officially launched! It's a drop-in replacement for running and serving @PyTorch, @tensorflow and @onnxai models much faster⚡️ and leverages the power Mojo🔥 for extensibility. Check out the blog post👇⬇️ modul.ar/max-launch-blog
7
27
143
43,010
Nick Kreeger retweeted
“Coding” was never the source of value, and people shouldn’t get overly attached to it. Problem solving is the core skill. The discipline and precision demanded by traditional programming will remain valuable transferable attributes, but they won’t be a barrier to entry. Many times over the years I have thought about a great programmer I knew that loved assembly language to the point of not wanting to move to C. I have to fight some similar feelings of my own around using existing massive codebases and inefficient languages, but I push through. I had somewhat resigned myself to the fact that I might be missing out on the “final abstraction”, where you realize that managing people is more powerful than any personal tool. I just don’t like it, and I can live with the limitations that puts on me. I suspect that I will enjoy managing AIs more, even if they wind up being better programmers than I am.
523
2,517
16,553
2,753,468
BBQ > Buffalo wings
24
253
2,215
185,772
Nick Kreeger retweeted
If you're in Oslo, Norway🇳🇴 on Feb 15th, come attend Modular engineer Fabian Tschopp's talk on accelerating Generative AI deployments using MAX and Mojo🔥. The talk is organized by SINTEF, register today: modul.ar/3tXhtRQ
2
3
19
3,359
Nick Kreeger retweeted
ModCon is coming 😱 It’s our premier AI developer conference and will feature product announcements, lightning talks, workshops, and expert discussions. December 4th, 2023 🗓️ at the Palace Hotel in San Francisco 🌉 Early bird tickets now available! 🔥modular.com/modcon/23/start
7
27
97
75,629
Nick Kreeger retweeted
The first crack at llama2.🔥 is here 🚀 A Mojo 🔥 community member - Mojician - did a simple port from Python to Mojo, and shows its already 20% faster than Karpathys llama.c implementation 😱 How much faster can it go? 📈
I was really excited that Mojo became publicly available and thinking which project can I implement to learn Mojo concepts. Since I have already ported llama2.c to pure Python, I decided why not try to port llama2.py to Mojo now 😀 And here is what I got...
27
180
1,134
322,297
Nick Kreeger retweeted
We are unveiling Mojo🔥 early, but we expect it to become a full superset of 🐍 Python 3 over time… and open source as it matures. Go to modular.com to check out Mojo🔥
4
25
112
17,775
Nick Kreeger retweeted
“Mojo 🔥 … is incredibly flexible, incredibly fast, can utilize the hardware you have … and is really understandable to Python programmers like you and me. I will actually enjoy writing neural networks again” - Jeremy Howard @jeremyphoward
4
46
238
45,354
Nick Kreeger retweeted
Mojo🔥 combines the usability of Python with the performance of C, unlocking unparalleled programmability of AI hardware and extensibility of AI models. Also, it's up to 35000x faster than Python 🤯 and … deploys 🏎
22
160
769
124,565
Nick Kreeger retweeted
Modular’s engine is built on next generation technology 🔥 that enables hardware innovators to unlock their AI differentiation with unprecedented usability, generality, performance and hackability 🚀
7
47
11,134
Nick Kreeger retweeted
Modular’s Engine has … modularity … and drops into the infrastructure that you already use while enabling insanely low latency 👏🏼🔥 Save money or scale your models to improve your products! 🦾 See how easy below👇🏼
7
33
8,402
Nick Kreeger retweeted
Tuesday is going to be wild. If you care about AI, developer tools, or software engineering, there is a good chance it will 🤯 your mind! Join us 9am pacific at modular.com
Life update: I started a new job at @Modular_AI! I was just about to accept an offer from Apple after leaving Google but after talking to @clattner_llvm and realizing how they planned to disrupt AI I knew I had to join. The public unveiling is Tuesday! modular.com/
6
30
225
109,790
Nick Kreeger retweeted
Announcing the world’s fastest unified matrix multiplication 🚀 A technical underpinning of the Modular stack 🔥 See our results now 👇🏼 and learn more about how it works at our event on May 2nd! 🍿 modular.com/blog/the-worlds-…
5
11
140
1,052,336