The Astra videos are fun. But I am trying a much cheaper setup with my laptop, around 11GB of open models and a $1.6k
@UnitreeRobotics Go2 Air
After one walk I can search what the dog saw and where it saw it. Next I want it to recognize those places when we go back and use that memory
This is the Air, not the EDU model with official support for secondary development. It was not really built for this, which makes it more fun
I drove it around my apartment (sorry for the mess) and
github.com/dimensionalOS/dim… (
@dimensionalos) recorded frames along with LiDAR, odometry and transforms. Having the images and the robot's position in one recording gave me something to build on
On the right of the video, the dog is map filling in with what it saw where. The left one shows what it detects
Three very small and open models ran later on my laptop:
SigLIP around 200M parameters, made the frames searchable.
huggingface.co/google/siglip…
Qwen3-VL-8B in 4-bit through
@ollama described the selected views and checked search result
github.com/QwenLM/Qwen3-VL
Moondream2, from
@moondreamai supplied the object boxes
huggingface.co/vikhyatk/moon…
All zero shot. We can upload the recordings and saved maps to the
@dimensionalos cloud and download them later. The goal is for the Go2 to know where he is and where is what
Next step is running this minimal stack on a 16 GB
@NVIDIAEmbedded Jetson mounted on the Go2 Air