New AI research from Meta – CoTracker3 Simpler and Better Point Tracking by Pseudo-Labelling Real Videos. More details ➡️ go.fb.me/xiyc63 Demo on @huggingface ➡️ go.fb.me/yzuqd0  Building on our previous work on CoTracker, this new model demonstrates impressive tracking results where points can be tracked for a long time even when they're occluded or leave the field of view. CoTracker3 achieves state-of-the-art, outperforming all recent point tracking approaches on standard benchmarks — often by a substantial margin. We've released the research paper, code and a demo on Hugging Face — along with models available under an A-NC license to support further research in this space.

Oct 16, 2024 · 4:53 PM UTC

43
307
1,805
219,123
Sort replies: Relevant Recent Liked
Replying to @AIatMeta @huggingface
Meta's AI vision gets sharper! 👁️🔍
1
208
Replying to @AIatMeta @huggingface
hell yeha
1
694
Replying to @AIatMeta @huggingface
Such an exciting innovation!!
1
86
Replying to @AIatMeta @huggingface
Meta's CoTracker3 sounds like a major advancement in point tracking! The ability to track points accurately, even when they're occluded or leave the field of view, is a huge leap forward. It’s exciting to see it outperform recent point tracking methods by a substantial margin. With the paper, code, and demo released on Hugging Face, this opens up big opportunities for further research and innovation. Can't wait to see how this impacts computer vision and related fields! Check out the details here: go.fb.me/xiyc63 and demo it here: go.fb.me/yzuqd0
1
487
Replying to @AIatMeta @huggingface
💡 Exciting advancements from #Meta! #Caduceus is all about supporting #AI innovations with edge rendering and decentralized infrastructure. We’re thrilled to see AI models like CoTracker3 pushing the boundaries in point tracking. Imagine the possibilities with #Caduceus backing next-gen AI on the blockchain!
1
231
Replying to @AIatMeta @huggingface
13
1,471
Replying to @AIatMeta @huggingface
It will be so easy to anchor things. If you can make every point cloud have it's own perfect GPS coordinate, it would be good.
1
6
823
Replying to @AIatMeta @huggingface
The paper introduces a new point tracking model called CoTracker3 that builds upon recent point tracking models like PIPs, TAPIR, and CoTracker. Point tracking is an important task in video analysis for applications like 3D reconstruction and video editing. The CoTracker3 model, when trained only on synthetic data, already outperforms state-of-the-art trackers on several benchmarks. When further fine-tuned on just 15,000 real-world unlabeled videos using the proposed protocol, it significantly surpasses the performance of BootsTAPIR, which was trained on 15 million real videos. CoTracker3 also shows better handling of occluded points compared to other models. full paper: openread.academy/en/paper/re…
1
7
1,057
Replying to @AIatMeta @huggingface
love how meta keeps open-sourcing these research
2
931
Replying to @AIatMeta @huggingface
Exciting development! Meta's new CoTracker3 could revolutionize point tracking in real videos.
1
1,086
Replying to @AIatMeta @huggingface
Your things @Mbounge_
1
2
1,119
Replying to @AIatMeta @huggingface
Exciting advancements from Meta with CoTracker3! 🎉 Tracking points even when occluded is a game changer! 📹🚀 Can't wait to check out the demo on Hugging Face. Kudos to the team for pushing the boundaries of point tracking technology! 💡
3
1
163
Replying to @AIatMeta @huggingface
CoTracker3 achieves state-of-the-art, outperforming all recent point tracking approaches on standard benchmarks
1
45
Replying to @AIatMeta @huggingface
wow!
1
623
Replying to @AIatMeta @huggingface
Amazing work
20
Replying to @AIatMeta @huggingface
Super cool work! Here's our recap x.com/ai_illuminated/status/…
23
Replying to @AIatMeta @huggingface
you guys are moving too fast, i even can't follow your path.👋👍
15
Replying to @AIatMeta @huggingface
This is wild.
1
772
Replying to @AIatMeta @huggingface
When are you going to release co-tracker under an Open Source/OSI license? It is the 3rd release under Creative Commons.
1
257
Replying to @AIatMeta @_akhaliq @huggingface
*stares into the void* the tracker tracks, but who tracks the tracker? 👁️
200
Replying to @AIatMeta @huggingface
this could really help the video industry!
398
Replying to @AIatMeta @huggingface
Amazing!!!
227
Replying to @AIatMeta @huggingface
@AIatMeta, that sounds like a step up in video tracking tech! Pseudo-labelling should make things smoother. You think it’ll change the game for real-time applications?
1
601
Replying to @AIatMeta @huggingface
Meta's CoTracker3 sounds like a major leap forward for AI point tracking! Looking forward to seeing how this improves video processing and other applications. Definitely checking out the demo on Hugging Face!
1
349
Replying to @AIatMeta @huggingface
@Abuzar_ii
1
392
Replying to @AIatMeta @huggingface
So like....anybody have something to use this for making masks in video editors yet?
8
Replying to @AIatMeta @huggingface
oooooooooh interesting. ping @ChrisVranos
95
Replying to @AIatMeta @huggingface
An intriguing innovation! Yet, does simplicity undermine accuracy? Questions remain.
1
1
1,379
Replying to @AIatMeta @huggingface
This new AI model from Meta sounds impressive! CoTracker3 could really push forward developments in point tracking technology
1
529
Replying to @AIatMeta @huggingface
Is possible to use this in VR to track everything without special hardware or QR tags?
178
Replying to @AIatMeta @huggingface
Wow
1
287
Replying to @AIatMeta @huggingface
What is it used for?
404
Replying to @AIatMeta @huggingface
Here is a fun AI video used in marketing x.com/PeopleHum/status/18486…
13
Replying to @AIatMeta @huggingface

ALT Jimmy Fallon Yes GIF by The Tonight Show Starring Jimmy Fallon
14
Replying to @AIatMeta @huggingface
MORE !!! We need to invest 1 Trillion per country in AI specifically META :) Love you
174