can you train an object tracker on the fly brain? yes! meet robofly 🪰 had fun hacking around to see how the fly brain lights up related to different visual inputs the difference between single object tracking and multiple things moving is really cool to see link to try it out below open to ideas and suggestions on where we should take this

we've started to evaluate Astra for segmentation tasks and it's really good but as we all know it's really expensive, ~$0.50 for a 1920 × 1280 image for example we think the best way to do zero-shot segmentation is to you use Astra on low/medium for object detection and then pass that to SAM3 you can get pixel perfect masks for 80% cheaper than having Astra draw polygons Astra proposes boxes, SAM3 draws the masks, and you get Astra's understanding with SAM3's edges at lower cost per image, because boxes are less complex than polygon lines, less Astra's output tokens

Speaker lineup and agenda announced for the Visual Intelligence Summit Going to be an intense day with 30+ speakers covering topics across industries, from robotics to frontier models, edge vision models to powerful agents running in the cloud Hands on workshops on - Model training and architectures - Frontier and multimodal models - Robotics and edge deployments - Data collection, curation, and labeling For anyone building in the vision space, this is the day to build your network and learn the latest advancements as you work at the frontier of what's possible with vision

Astra built a complex breathing detection application This video actually steps through the front-end to show you how Astra built it, not just a demo. He gave Astra a stack of videos of himself breathing and let it figure out the rest. Astra ran five experiments on its own to come to the best conclusion. We'll be sharing more behind the scenes on how Astra demos are being built

New tutorial on how to use Astra for training smaller models Astra is powerful but too expensive for many use cases most Astra demos don't make sense as production applications so we made a tutorial showing how you can use Astra's vision capabilities to train smaller more efficient models like RF-DETR Preview here, full tutorial in next post

end to end data labeling tutorial with Astra

we've been testing astra across domains and are finding some surprises and specific areas it is reliable exciting zero-shot knowledge wins happening here, mainly understanding which player scored! a lot goes into that: - knowing in/out of court and service box - who hit last - understanding a point ended - game knowledge of missed first-serve doesn't result in a point other cool things here you get out of the box - understanding the stroke - tracking player to assign points would be easy to add - stroke counts - heat map - point durations