My first first-authored (w/ @shobsund) paper of my phd is finally out! 🚀 Check out our thread to see how general-purpose representations + personalized synthetic data enable personalized vision representations. 🌐: personalized-rep.github.io
Personal vision tasks–like detecting *your mug*-are hard; they’re data scarce and fine-grained. In our new paper, we show you can adapt general-purpose vision models to these tasks from just three photos! 📝: arxiv.org/abs/2412.16156 💻: github.com/ssundaram21/perso… (1/n)
6
7
160
28,540
Julia Chae retweeted
What internal structure do experts in multimodal MoEs develop during pre-training? Can we put this structure to practical use to make model adaptation significantly faster? In our new blog post and paper with @RaphiKang and @georgiagkioxari we discuss this and more 👇
1
10
25
2,533
check out this cool work by jenny highlighting importance of human verification before blindly accepting LLM outputs when using them within our workflow 👀
new preprint: language models are “insecure” reporters. researchers and engineers have become increasingly reliant on LLM-written reports---second-hand accounts of code and experiments---to understand agent-generated work. in this study, we ask: “how transparent are these LLM-generated reports?” 🔍
1
5
707
Julia Chae retweeted
Make UMAP and embeddings cool again
Taking a short break from LLM research to go back to my roots. Introducing... Concept Lenses! A training-free way to do similarity search along whatever concept you care about. Typically, embedding-based similarity search is constrained by whatever notion of similarity the model learned in training. This means that if the model is primed for semantic similarity, but you actually care more about visual appearance, you'd need to switch models. Under a Concept Lens projection, though, distance between embeddings means distance only along the concept you care about. Blog post: jasperlu.com/blog/prompted-s… Demo: jasperlu.com/projects/concep…
3
2
98
12,409
🤩 love to see scaled up supervision from clever alternative domain sources of data! synthetic data for CT go brr
X-rays are everywhere in medicine, but extracting general, quantitative anatomical information from them remains remarkably difficult. Announcing FleXray: an open-source, open-weight model for zero-shot anatomical segmentation across the human body—from different regions, viewing angles, and acquisition settings. FleXray learns from large-scale synthetic supervision generated from 3D anatomy, then transfers directly to real clinical X-rays. Try it now on your own X-rays in our in-browser demo! 🧵 1/N — project page, demo, weights, code & paper below ↓
1
8
607
Julia Chae retweeted
a rollout from persimmon where a neolab employee gets asked what they work on and they have to deflect no longer me after today hiring btw @humansand
5
5
57
10,789
Julia Chae retweeted
So proud to announce what I’ve been working on over the last few months with the incredible @314Bansal & many other talented humans! Persimmon is a huge first step towards a future where AI is built *for people* and we can’t wait to see what work it inspires 🌟 Do reach out (or request access to our research preview!) if you’re interested in learning more.
For AI to work with us, it needs to understand us Today, we're introducing Persimmon, the first large-scale model designed to realistically simulate how people talk and interact
20
11
142
13,623
Julia Chae retweeted
How similar are two images? Prior metrics (e.g., LPIPS, DreamSim) give just a single score. But actually, there are multiple *senses* of similarity (color, pose, etc.) We introduce TPIPS -- Text-Prompted Image Perceptual Similarity "pip install tpips" peterwang512.github.io/TPIPS 🧵
6
58
347
39,673
Now published in @ECOLINFORM 🎉 We show open-ended VLM retrieval can work inside an actual ecological workflow, turning ~300M incidental iNaturalist photos into a queryable dataset — surfacing previously buried phenomena and widening the range of answerable scientific questions.
iNaturalist has 300M+ images with ecological signals—diet, habitat, etc.—visible but rarely annotated and thus inaccessible at scale. Can AI help scientists access these signals from raw imagery? INQUIRE-Search makes large ecological databases discoverable via natural language.
3
18
1,497
less than 2 weeks until the archival track deadline!!
Our Archival Track deadline is coming up soon and has been extended to July 15th! Looking forward to another great round of submissions 🙂
2
4
672
Don’t miss this work at ICML!!
I'll be at #ICML2026 to present our *spotlight* work! TLDR: LLMs can learn to self-generate curricula for problems they can't yet solve, using self-play with meta-RL. Please reach out to chat about self-improving agents, synthetic data & environments, curriculum learning, or anything else! We've updated the paper with some fun additions ⬇️
12
2,377
Julia Chae retweeted
🤖 We introduce Ambient Diffusion Policy, a simple and principled method for training policies with suboptimal data in robotics. Suboptimal data is everywhere in robotics… ❌ Data filtering is wasteful ❌ Co-training learns both good and bad features ✅ Ambient Diffusion Policy selectively learns useful features via noise-dependent data usage 👇🧵(1/5)
17
56
340
117,183
As ecological data collection scales, expert-in-the-loop annotation is becoming essential. These workflows are inherently transductive: the goal is to efficiently label a fixed pool of collected data.
1
2
7
1,028
Julia Chae retweeted
We never really knew how to train nonlinear RNNs well… BPTT struggled with vanishing grads (no long-range memory) and sequential rollout (hard to parallelizable). What if instead an oracle told us the optimal memory state m_t at each step? Then the RNN could do one-step supervised learning on (m_t, x_{t+1}) → m_{t+1} labels. We call this Supervised Memory Training (SMT): a replacement for BPTT that trains RNNs without unrolling them. SMT is time-parallelizable and solves vanishing gradients. Website: akarshkumar.com/smt/ arXiv: arxiv.org/abs/2606.06479
18
119
808
188,201
Julia Chae retweeted
It was awesome!! Great to meet so many of you and get outside together ❤️🐦
1
3
8
960
Presenting tomorrow (Friday June 4) at @CVPR Poster Session #2 from 4pm-6pm 📍ExHall A, #378 Looking forward to chatting!
Excited to share ID-Sim, our identity-focused similarity metric, presenting at #CVPR2026 this week in Denver! 🎉 Humans are remarkably good at distinguishing highly similar objects across different contexts. We asked: can we train a metric that does the same?
1
15
2,128
Excited to share ID-Sim, our identity-focused similarity metric, presenting at #CVPR2026 this week in Denver! 🎉 Humans are remarkably good at distinguishing highly similar objects across different contexts. We asked: can we train a metric that does the same?
2
12
46
7,603
Huge thank you to the wonderful collaborators! Would not be possible without guidance from mentors at @AdobeResearch during my internship Cusuh Ham (@cusuh_ ), Jui-Hsien Wang (@JuiHsienWang1), Nicholas Kolkin, Richard Zhang (@rzhang88) and my advisor Sara Beery @sarameghanbeery
1
2
203
Poster will be presented at: 🗓️ Poster Session 2 on Friday, June 4 📍Poster #378, Exhibit Hall A
1
1
302
Julia Chae retweeted
Exciting work on fine-grained visual similarity, led by my intern, Julia. Come by the afternoon poster session on Friday to say hi and learn more! #CVPR2026
Excited to share ID-Sim, our identity-focused similarity metric, presenting at #CVPR2026 this week in Denver! 🎉 Humans are remarkably good at distinguishing highly similar objects across different contexts. We asked: can we train a metric that does the same?
1
11
805
Julia Chae retweeted
Huge congrats to my graduate student @juliachae_ on ID -Sim! We will be presenting a poster on this exciting new identity-focused similarity metric at #CVPR2026 this Friday afternoon, in Poster Session 2 (# 378). Come say hi!!
Excited to share ID-Sim, our identity-focused similarity metric, presenting at #CVPR2026 this week in Denver! 🎉 Humans are remarkably good at distinguishing highly similar objects across different contexts. We asked: can we train a metric that does the same?
2
11
1,662
Julia Chae retweeted
Super cool work from @juliachae_ that fills an important gap in image similarity metrics!
Excited to share ID-Sim, our identity-focused similarity metric, presenting at #CVPR2026 this week in Denver! 🎉 Humans are remarkably good at distinguishing highly similar objects across different contexts. We asked: can we train a metric that does the same?
3
6
1,412