One thing we've been excited about since the beginning of Gabber is Avatars
Here we have Visemes animating the mouth on a ThreeJS rendered realtime AI powered VRM avatar
Can I build a realtime basketball coach that counts my shots and gives me voice feedback on my jump shot?
Using Qwen3-VL 30B and a conversational AI, I found out - build tutorial at the end
Link to try it below
Introducing Gabber
Realtime, multimodal AI inference + orchestration for Vision, Speech, and Language Models
Build AI that can see, hear, talk, call tools, and do anything for $1/hr
I built an AI personal trainer that counts reps for me
It went a little bit horribly wrong, but it mostly worked great
I'll link a blog post on exactly how I built it below
A real-time learning assistant that sees your screen, talks, and learns alongside you. All open-source models (Qwen3-VL, Parakeet, Orpheus) wired together
Homework, research, studying - all made easier
Watch the video to see just how well it did
Turned @Alibaba_Qwen 3-Omni into a screen-aware code copilot. It watches @dwyer_neil 's screen, catches issues problems, and suggests fixes. Ran on H100 (FP8 Dynamic Quant) via @GabberDev
New open-source multimodal models are wild. They don’t just read and write, but can see, hear, and think.
Here’s @Alibaba_Qwen Qwen3-Omni (thinking mode) running locally on an H100.
Smarter than 2.5, handles voice, tool calls, and real-time context.
@GabberDev will set these models free.
Why is it that all conversational voice AI agents are one-on-one? And what if I told you that they don't have to be?
2+ people. 2+ AI - that's now possible
Current voice AI platforms are LLM sandwiches. You take your meat (your LLM), you wrap it in speech models (STT and TTS), you stack it together (with something like LiveKit).
That's not to say being an LLM wrapper is bad, but more that you literally can't add participants without building special infrastructure to support it. i.e. Slapping a TTS and STT system around an LLM does not leave much room for innovation.
You need new infra and new orchestration. And infra cannot be vibe coded. It requires real investment and is more akin to configuration than logic.
We built a system that lets you build multi-participant conversational Voice AI and it was trivial using Gabber's new Multi-participant STT node and templating system.