Currently hacking on the Humane Ai Pin (previously Vision Pro and Analogue Pocket). Mastodon: fosstodon.org/@agg23

Big Humane Ai Pin milestone: Full preservation of the original experience, entirely on-device. I've applied Humane's UX work and polish so we can build whatever functionality we want Video: Ai Mic -> cosmOS -> Gemini -> live search Powered by PenumbraOS penumbraos.com/
6
5
31
3,138
Rough M5 Ultra 80 core GPU 256GB benches: Qwen 3.8 Flash Next, Q4 variants, MTP, 1 stream, 32k context, averaged code/prose: TensorFold 0.3.4.1: 152 tok/s decode, 2086 tok/s prefill mlx-serve 26.9.6: 124 tok/s, 3863 tok/s prefill oMLX 0.7.0rc1: 105 tok/s, 3694 tok/s prefill
9
37
9,303
Somewhat similar TensorFold numbers against M3 Ultra
Long Context Benchmark: TensorFold 0.3.4.1 + PR 29 and PR 30 on M3 Ultra with Qwen 3.8 Flash Next 4bit. 🔥 Now prefill is great and there are no more issues with 64K+ context on first decode request. Here a comparison 0.3.4, 0.3.4.1 and this version. Peak: - 0.3.4.2 130 t/s - 0.3.4 128 t/s - 0.3.4.1 119 t/s
1
439
It is pretty hard to approach this scientifically, especially since I am not familiar with the field. I would not be surprised if the choice of quants messed up the engine comparisons significantly. TensorFold in particular is built for a very specific model + quant at the moment
3
231
Could only get oMLX to run Q8, so here's a Q4 vs Q8 comparison for oMLX only. Seems to be a ~12-14% cost to moving to Q8 ad the moment. 95 tok/s Q8 vs 105 tok/s Q4 @ 32k
1
1
398
I think there's a lot of headroom to be squeezed out still, and it's obviously early in the chip's life. A rough test shows the GPU can draw ~162W. GPU power, decode / prefill: TensorFold: 97 W / 123 W mlx-serve: 87 W / 130 W oMLX: 71 W / 150 W Decode maxes out at 430-460 GB/s
2
292
I'm excited to begin testing the M5 Ultra 256GB Mac Studio Benchmarks seem rare at the moment. Tell me a good benchmark regimen (test set, models, engines) and I'll attempt to get some comparable numbers I would like to see numbers taken by the same author in similar scenarios
1
6
475
It's hard to find reliable sources for a given model and quant. My current plan: Vontra/GLM-5.3-Flash-MLX-oQ4-MTP Vontra/Qwen3.8-Flash-Next-MLX-8bit-MTP mlx-community/GLM-5.3-Flash-4bit mlx-community/Qwen3.8-Flash-Next-oQ6e-mtp mlx-community/Qwen3.8-Flash-Next-oQ8e-mtp
1
1
189
I imagine there will probably be some numbers contamination by the need to use different inference engines, but I don't know if that can be helped
145
Adam Gastineau retweeted
I’ve wanted to see FPGA-accelerated Godot games for a while, and the new GameBub feels like a great platform to finally try it. The challenge is analyzing the game, finding what’s worth accelerating, then mapping it to reusable FPGA hardware or game-specific accelerators.
2
2
24
2,007
My completely open source GameBub FPGA handheld arrived today. The device has more FPGA resources than the Analogue Pocket, so hopefully people can make some cool stuff I’m immediately blown away at how polished this is from a single individual. You did a great job @eli_lipsitz
6
3
42
3,026
I suppose maybe "my" was the wrong choice of word. This is all Eli's work. I just spent the money to receive one and support the project.
281
Replying to @eli_lipsitz
Go buy it from crowdsupply.com/second-bedro… Everything on this device is customizable and it comes in a nice injection molded case. The size is nice
6
334
Adam Gastineau retweeted
1/ Open-sourcing openfpgaOS: an experimental OS for FPGAs, for non-threaded apps. Like DOS, but full 32-bit with a POSIX API. RISC-V soft core, musl, C/C++ and an SDL2 shim. Doom, Quake, Diablo and ScummVM run on it. 🧵
5
38
244
11,000
Updated my Virtual Boy emulator for Vision Pro and iOS, VirtualFriend, to have artwork for the new Nintendo Online games and various fixes/perf improvements. VirtualFriend is free and open source. Try it out! apps.apple.com/us/app/virtua… github.com/agg23/virtualfrie…
2
1
20
1,049
Lots of fixes for visionOS 26/27 in particular. Seems like Apple broke a lot of different things. Took me many hours to work through them all.
3
159
I just discovered a product for making true frozen carbonated beverages (what "ICEE" is) at home. I really want one
Fizzy, frozen and ready in minutes. @briantong and @ijustine put Iceplosion to the test on the CES 2026 show floor — turning a regular kitchen into a slushie bar with a little science and a lot of fun.
3
1,048
Adam Gastineau retweeted
🚨 Diablo has arrived on openfpgaOS! The legendary dungeon crawler is now playable in your Analogue Pocket. Hack, slash, and loot your way through the depths.
6
19
90
10,077
Very cool use of the Analogue Pocket
Quake has been given the openfpgaOS treatment with improved textures and lighting!
14
1,160
Adam Gastineau retweeted
The immich team has just posted a 2 year retrospective going over their experiences with everyone at FUTO. Highly recommended reading for anyone who is interested in pitching us on new projects!
2
19
2,078