Apache-UAE
@ApacheAE

Building autonomous AI agents. Lawyer by training, engineer by night. Building from Dubai → everywhere..

 Dubai, United Arab Emirates
localforge.ai
Joined October 2021
27 Photos and videos
113 tok/s think off. 70 tok/s at xhigh. 960 / 892 tok/s prefill at 64k and 258k. Mac Studio M3 Ultra 256GB, mlx-serve, nothing else loaded.
Article

Flash-Next on a Mac Studio M3 Ultra 256GB: 113 tok/s (mlx-serve)

Qwen3.8-Flash-Next on mlx-serve, this Mac Studio, nothing else loaded. Think off: 113 tok/s decode Think xhigh: 70 tok/s decode 64k prompt: 960 tok/s prefill 258k prompt: 892 tok/s prefill That is

3
1
1
12,841
Load more