Spatial Intelligence to perceive the real world multiset.ai/

Adding 4D location and time to each capture on the site across splats, digital twins and meshes
1
5
102
5,022
With MultiSet, a Gaussian Splat becomes more than a 3D representation. It becomes a positioning layer, giving both humans and machines a sense of space.
1
2
10
412
MultiSet AI retweeted
Added a 360° camera on top of the Go2 to improve localization robustness through multi-viewport observations.
3
13
1,282
MultiSet AI retweeted
A robot's first job on boot is working out where it is. SLAM does that by exploring. A shared map does it from one frame with @multiset_ai. Around 95% of what a robot does in a facility is travel to and from a location.
1
2
43
Launching the MultiSet Python package for @UnitreeRobotics Go2. It works with the existing onboard camera to correct odometry drift using MultiSet VPS localization. github.com/MultiSet-AI/multi…
1
5
778
Convert your 3DGS to a positioning system!
My phone thinks I'm on 42nd Street, but I'm in the subway two levels down. GPS can't handle it, but VPS can. I feed gaussian splatting of a location and can then localize to provide directions. Here's it navigating me to the 4,5,6 train in NYC.
6
540
Going live with Unitree Go2 soon!
Unitree Go2×MultiSet AIによるVPS位置補正 🔹既存カメラと6DoF VPSの併用で自己位置ドリフトを補正 🔹ローカルオドメトリを維持しつつマップ上のグローバル位置を修正 🔹追加センサーなしでPhysical AIの位置特定精度向上 既存カメラと共有マップを活用した位置特定アプローチ。 情報元はリプ欄。
1
1
5
456
Camera pose estimation at its peak!
Hundreds of 2d photos lifted into 3d. Left exactly when and where they happened at TED. Now I can fly through this spatial memory palace and jump between moments -- from the green room to backstage to the main stage. Imagine your entire camera roll coming to life like this.
1
362
MultiSet AI retweeted
Two corridors in the same plant look identical to a camera. Most VPS does not fail there. It returns a confident wrong pose and sends a technician to the wrong asset. @multiset_ai Repeating geometry is not an edge case. It is what industrial space looks like.
1
4
49
MultiSet AI retweeted
We ran an experiment at a live show at the California Theatre: find the 3D location of every photo taken during the event. Live shows are one of the hardest environments for a VPS. Low light. Smoke. Strobes. Almost every photo pointed at the performer. Hundreds of people moving through the frame.
3
11
1,574
MultiSet AI retweeted
watching niantic go from pokemon go to selling maps to robots is the most interesting pivot in tech. they figured out a decade ago the game was never the product, the map was. @multiset_ai was right all along
1
1
4
167
MultiSet AI retweeted
Literally any skyline photo from your window is giving away your exact address. Check out these photos I took around Austin, precisely geolocated by matching pixels against a 3D scan. The most insane match was a photo I took inside a high rise looking down. It nailed the exact balcony.
37
137
1,401
74,588
MultiSet AI retweeted
We just released @multiset_ai VPS Gen2, built for cross-modality localization: localizing camera images against 3D map tiles, Gaussian splats, and other 3D representations. This opens VPS up to existing GIS data. No remapping with image-based capture required. The videos below show it in action: a photorealistic 3D tile as the map input, and a handful of images captured by a reviewer years apart, all localized against that tile, powered by VPS Gen2.
1
1
5
369
Enabling accurate positioning in existing GIS data with VPS Gen2
MultiSet AIが異種モダリティ対応の「VPS Gen2」を公開 カメラ画像を3DマップタイルやGaussian Splat等の3Dデータと位置合わせ可能に。 既存のGISデータを直接活用でき、再撮影での再マップ作成が不要。 数年前の画像でも正確に特定可能。 詳細はリプ欄。
9
607
MultiSet AI retweeted
Same map. Same building. Day and night. @multiset_ai localizes the same physical space across lighting conditions, so a robot or pair of smart glasses knows exactly where it is at noon or midnight. Lighting changes. The map doesn't. That's what physical AI needs to actually work in the real world.
2
2
4
539
MultiSet AI retweeted
Anchor 360 videos, Gaussian Splats and LiDAR data to the physical world Reality capture shouldn't end at a high-fidelity model of the world With @multiset_ai , we make reality trackable for precise 6DoF tracking across phones, glasses, and robots.
3
3
197
MultiSet AI retweeted
We're excited to welcome @multiset_ai to the #XGRIDS #LCC2 ecosystem. MultiSet gives every robot, drone, and worker a shared, precise map of the physical world — independent, deployable anywhere, with no lock-in.
1
3
10
527
We are thrilled to announce that MultiSet has won the Auggie Award for Best Developer Tool! 🏆 A huge thank you to the incredible community of creators deploying our visual positioning technology in real-world environments.
1
3
990
Mapping the world, pixels to points
This tech maps the physical world in 3d and snaps it perfectly to my camera feed at 60 fps. Visual Positioning Systems (VPS) are the under hyped backbone of spatial computing. This is how we connect the world of bits & atoms.
5
10
856