Matt Bornstein retweeted
I’m crying of laughter - please let this be the model that solved Navier-Stokes (this guy’s name is hayZee, we need to get him on here!)
64
91
870
89,713
Matt Bornstein retweeted
DiffusionGemma-Jev now runs on vLLM 🚀 Ask yes/no, multiple-choice, or scored questions and get confidence with every answer. vLLM seeds a canvas with the response template, leaves only the answer slots noisy, then reads a probability distribution from every slot in a single denoising step. Huge thanks to @mmastrac for driving this upstream! 🙏 github.com/vllm-project/vllm…
Deploying DiffusionGemma-Jev (djev) just got a lot easier. You can now spin up a Jev API-compatible endpoint on Google Cloud Run using a single command. Performance is solid: ~35-60 ms for single step latency and batch@32 is ~100-123 requests/sec. It's a straightforward way to experiment without needing your own GPU. Runs at roughly $3/hr and drops to $0 when idle. Get the code and instructions here: github.com/taeold/djev-run
24
135
1,274
104,780
Matt Bornstein retweeted
My talk from @theallinpod conference. You can learn a bit more about what we're up to @unconvAI !
All-In Summit: Naveen Rao -- Why AI is extremely inefficient, and how to fix it -- AI is about to run out of power -- Your brain does this on 20 watts, the data center needs a city -- Every computer since 1945 is built wrong -- Why the doomers have the energy story backwards ++ much more! (0:00) Welcome @NaveenGRao (4:45) Is energy really the problem? The cost of a token, power contracts & the gap to close (10:24) Cutting out the middleman: abstractions, dynamical systems & a new kind of machine (19:40) Chamath joins: the path to product, porting existing models & building the team
6
9
92
9,073
PSA: I don't use Telegram, anyone claiming to be me is not me
2
2
738
Matt Bornstein retweeted
I made some public disclosures about our hardware at the @theallinpod conf this week and wanted to share the progress here. Earlier this summer we got hardware back! The execution was madness…we went from no team in Jan to a tape out in 5 months. AI enabled MUCH tighter loops of research and our execution speed shows the results. This is the first large-scale demonstration of a causal, physical dynamical system to do real compute. 🚀 We released the Un-0 model (see link) in June and it runs on this physical system; the images below come from the actual hardware. What’s more, this chip requires <900 nJ to generate an image; this is many orders of magnitude less energy than conventional machines. unconv.ai/blog/introducing-u…
24
44
375
462,809
IQ points per watt: Humans: 5 AI: 0.000001
1
2
842
Matt Bornstein retweeted
This is “six feet to stop the spread” all over again. But with one difference: “killer AI” doesn’t exist. Covid did. The only thing going viral this time is cluelessness. Layers of pseudo-science and virtue signaling in the absence of critical thinking… Dario said that GPT-2 was too dangerous to release in 2019
Ossoff: ​​This week we were warned again of existential risk to the human species. Did you see it? And what fills us with dread is the crushing weakness of our politics against the massive stakes of our times. Tech titans dig bunkers while warning us the new intelligence they're creating risks human extinction. Congress debates youth sports, and the president builds a ballroom. An ancient establishment, barely capable of email, sleepwalks into a technological revolution, while the president dismantles precautions and calls us fools for worrying. Just listen to this: On day one, Donald Trump rescinded the AI safety order meant to guard against catastrophic risks, including the engineering of bioweapons. Meanwhile, Don Jr.'s 1789 Capital bought big money stakes in data centers and AI labs. Four days before inauguration, the Emirati spy chief committed $500 million to the Trump family crypto business, and four months later, the Trump administration granted the Emirates the rights to buy our most sensitive AI chips.
9
24
163
32,708
Matt Bornstein retweeted
Anthropic is switching back to Doomer FUD because OpenAI beat them to that millennium prize finding in math just before the IPO. It's probably their worst habit: if they're not winning, AI is going to kill everyone.
28
200
2,694
89,670
OR its a good thing that AI companies are willing to subsidize large amounts of compute, and pay high salaries to mathematicians, to achieve fundamental mathematical breakthroughs... hmm...
I consider @sama a friend. But let’s think about what this means. It means if you were to do the impossible as a mathematician and prove the Riemann Hypothesis or P=NP, you can’t buy a home with your winnings in Atherton next to VCs & CEOs. Navier-Stokes may be worth Billions.
1
5
1,326
turns out @polynoamial was really, really right about test-time scaling
Replying to @OpenAI
This model represents a step-function improvement on many benchmarks, and its training is ongoing. Our internal model group arrived at the Navier–Stokes solution in 88 hours, using around 10,000 coordinating AI agents. Throughout the effort, we maintained the strict safeguards—including monitoring and isolation—that we apply to all our frontier evaluations.
7
629
The Navier-Stokes controversy has to sustain for 12+ years to get even close to this kind of spiteful record
1
1
7
580
this is amazing (just running n64 in browser is cool!)
I love Smash 64 but I wish I was in it, so I hacked the original game to run in the browser and put myself + 1000 others in Upload yourself at smash dot fun
10
1,281
have we considered the possibility that Bernie Sanders has AI psychosis?
1
8
520
This excellent post about AI compilers leaves out the key detail: i.e. how to verify program correctness @cdleary I asked 5.6-sol how you did it, what do you think? 🙂
2
3
831
This is the right take. Machine learning has *always* been a black box. Darpa even ran a grand challenge once to try and solve this (didn't work). AI models are fundamentally empirical beasts, and need to be measured like a natural phenomenon. See also: why do airplanes stay up in the sky
i agree with this and think that CoT is at best an epiphenomenon of current training methods. it will break (in the future, not now). safety community too often centers thought terminating taboos like “neuralese” and “training on interp”
1
8
1,064
Matt Bornstein retweeted
a viable worktree alternative for 90% of use cases: docs.gitbutler.com/ai-agents…
Letting models use worktrees was a terrible idea. They are all over the place, they are never cleaned up, and they are huge with lots of duplication, clogging up the whole disk in no time. Awful.
2
1
22
89,862
I've been waiting for this.. world generation with precise control! really big deal if you've tried normal splat generation before. very hard to get the details right.
Introducing Atlas: The world's first multimodal world model that generates image and video frames with pixel-perfect camera control and reconstructs them in 3D. Model the world, move the camera, and simulate space & time.
3
1
28
3,104