Stanford CS PhD w @jure and @guestrin. Prev. CMU w @zacharylipton, IIT Delhi. I like neural networks.

Stanford, CA
Transformers are great for sequences, but most business-critical predictions (e.g. product sales, customer churn, ad CTR, in-hospital mortality) rely on highly-structured relational data where signal is scattered across rows, columns, linked tables and time. Excited to finally share what I have been working on over the last year: a Foundation Model architecture which brings the power of Transformers to relational domains, enabling large-scale pretraining and zero-shot generalization in enterprise settings. 🧵1/n
5
40
151
61,086
rishabh ranjan retweeted
Looking forward to VLDB in Boston this week! I’ll be on the job market this year for CS faculty positions. I’m also co-organizing the NOVAS workshop tomorrow, featuring research at the intersection of data systems and AI, including semantic operator optimization and agentic data systems. Please reach out if you’re attending—I’d love to meet and chat!
1
6
46
5,633
rishabh ranjan retweeted
Super excited about our first work on relational learning, continuing to push on open source!
We’re happy to announce our first release in relational learning at Prior Labs, continuing our commitment to open science. We open-source three pieces of software that we expect to accelerate research in the field towards meaningful, real-world impact. First and foremost, we release 𝗥𝗲𝗹𝗔𝗿𝗲𝗻𝗮-α: a unified framework for running and comparing baselines on RelBench v1 tasks. Based on learnings from tabular benchmarks like TabArena, we are standardizing data loading, evaluation protocols, tuning regimes, and adding support for systems with custom tuning. We also open-source 𝗧𝗮𝗯𝗣𝗙𝗡-𝗥𝗲𝗹: our relational harness for TabPFN-3. We initialize the (living) RelArena-α leaderboard with TabPFN-Rel and a comprehensive set of baselines. The rankings at the time of release are: • 𝗧𝗮𝗯𝗣𝗙𝗡-𝗥𝗲𝗹 is the No. 1 model submission • 𝗥𝗧-𝗣𝗹𝘂𝗥𝗲𝗹 is the No. 1 system submission Last but not least, we open-source an alpha version of the 𝗥𝗲𝗹𝗮𝘁𝗶𝗼𝗻𝗮𝗹 𝗣𝗿𝗲𝗱𝗶𝗰𝘁𝗶𝘃𝗲 𝗜𝗻𝘁𝗲𝗿𝗳𝗮𝗰𝗲 (𝗥𝗣𝗜): enabling you to easily specify prediction tasks on your own relational database and then run any RelArena-α model, like TabPFN-Rel, in a few lines of code, all bundled as a simple PyPI package. • Read the full model report: arxiv.org/abs/2608.16319 • GitHub repository (give us a ⭐️): github.com/PriorLabs/relaren… • Announcement: priorlabs.ai/blog-posts/intr… • Docs: docs.priorlabs.ai/capabiliti… Thanks to the contributions from: @adrihayler, @KNfloege, @AlanArazi1536, @_rishabhranjan_, @jure, @LennartPurucker, @FrankRHutter & @noahholl
1
4
23
1,817
rishabh ranjan retweeted
Excited to see this out! Relational learning needs strong benchmarks, standardized evaluation, and easy ways to bring methods to real-world relational data.
We’re happy to announce our first release in relational learning at Prior Labs, continuing our commitment to open science. We open-source three pieces of software that we expect to accelerate research in the field towards meaningful, real-world impact. First and foremost, we release 𝗥𝗲𝗹𝗔𝗿𝗲𝗻𝗮-α: a unified framework for running and comparing baselines on RelBench v1 tasks. Based on learnings from tabular benchmarks like TabArena, we are standardizing data loading, evaluation protocols, tuning regimes, and adding support for systems with custom tuning. We also open-source 𝗧𝗮𝗯𝗣𝗙𝗡-𝗥𝗲𝗹: our relational harness for TabPFN-3. We initialize the (living) RelArena-α leaderboard with TabPFN-Rel and a comprehensive set of baselines. The rankings at the time of release are: • 𝗧𝗮𝗯𝗣𝗙𝗡-𝗥𝗲𝗹 is the No. 1 model submission • 𝗥𝗧-𝗣𝗹𝘂𝗥𝗲𝗹 is the No. 1 system submission Last but not least, we open-source an alpha version of the 𝗥𝗲𝗹𝗮𝘁𝗶𝗼𝗻𝗮𝗹 𝗣𝗿𝗲𝗱𝗶𝗰𝘁𝗶𝘃𝗲 𝗜𝗻𝘁𝗲𝗿𝗳𝗮𝗰𝗲 (𝗥𝗣𝗜): enabling you to easily specify prediction tasks on your own relational database and then run any RelArena-α model, like TabPFN-Rel, in a few lines of code, all bundled as a simple PyPI package. • Read the full model report: arxiv.org/abs/2608.16319 • GitHub repository (give us a ⭐️): github.com/PriorLabs/relaren… • Announcement: priorlabs.ai/blog-posts/intr… • Docs: docs.priorlabs.ai/capabiliti… Thanks to the contributions from: @adrihayler, @KNfloege, @AlanArazi1536, @_rishabhranjan_, @jure, @LennartPurucker, @FrankRHutter & @noahholl
2
1
24
7,310
🥇Our relational foundation model RT-PluRel is the #1 system on RelArena-α! 👏Kudos to the Prior Labs team for this very meaningful contribution to the community, and for TabPFN-Rel being the #1 model. 🤗The RT-PluRel model: huggingface.co/stanford-star… 📰RT: star-project.stanford.edu/rt… 📰PluRel: star-project.stanford.edu/pl… (shoutout to @kvignesh1420, @guestrin) 🙇I learnt a lot from this collaboration, especially thanks to @adrihayler and @LennartPurucker. The future of relational learning looks strong!
We’re happy to announce our first release in relational learning at Prior Labs, continuing our commitment to open science. We open-source three pieces of software that we expect to accelerate research in the field towards meaningful, real-world impact. First and foremost, we release 𝗥𝗲𝗹𝗔𝗿𝗲𝗻𝗮-α: a unified framework for running and comparing baselines on RelBench v1 tasks. Based on learnings from tabular benchmarks like TabArena, we are standardizing data loading, evaluation protocols, tuning regimes, and adding support for systems with custom tuning. We also open-source 𝗧𝗮𝗯𝗣𝗙𝗡-𝗥𝗲𝗹: our relational harness for TabPFN-3. We initialize the (living) RelArena-α leaderboard with TabPFN-Rel and a comprehensive set of baselines. The rankings at the time of release are: • 𝗧𝗮𝗯𝗣𝗙𝗡-𝗥𝗲𝗹 is the No. 1 model submission • 𝗥𝗧-𝗣𝗹𝘂𝗥𝗲𝗹 is the No. 1 system submission Last but not least, we open-source an alpha version of the 𝗥𝗲𝗹𝗮𝘁𝗶𝗼𝗻𝗮𝗹 𝗣𝗿𝗲𝗱𝗶𝗰𝘁𝗶𝘃𝗲 𝗜𝗻𝘁𝗲𝗿𝗳𝗮𝗰𝗲 (𝗥𝗣𝗜): enabling you to easily specify prediction tasks on your own relational database and then run any RelArena-α model, like TabPFN-Rel, in a few lines of code, all bundled as a simple PyPI package. • Read the full model report: arxiv.org/abs/2608.16319 • GitHub repository (give us a ⭐️): github.com/PriorLabs/relaren… • Announcement: priorlabs.ai/blog-posts/intr… • Docs: docs.priorlabs.ai/capabiliti… Thanks to the contributions from: @adrihayler, @KNfloege, @AlanArazi1536, @_rishabhranjan_, @jure, @LennartPurucker, @FrankRHutter & @noahholl
1
10
24
1,412
rishabh ranjan retweeted
We’re happy to announce our first release in relational learning at Prior Labs, continuing our commitment to open science. We open-source three pieces of software that we expect to accelerate research in the field towards meaningful, real-world impact. First and foremost, we release 𝗥𝗲𝗹𝗔𝗿𝗲𝗻𝗮-α: a unified framework for running and comparing baselines on RelBench v1 tasks. Based on learnings from tabular benchmarks like TabArena, we are standardizing data loading, evaluation protocols, tuning regimes, and adding support for systems with custom tuning. We also open-source 𝗧𝗮𝗯𝗣𝗙𝗡-𝗥𝗲𝗹: our relational harness for TabPFN-3. We initialize the (living) RelArena-α leaderboard with TabPFN-Rel and a comprehensive set of baselines. The rankings at the time of release are: • 𝗧𝗮𝗯𝗣𝗙𝗡-𝗥𝗲𝗹 is the No. 1 model submission • 𝗥𝗧-𝗣𝗹𝘂𝗥𝗲𝗹 is the No. 1 system submission Last but not least, we open-source an alpha version of the 𝗥𝗲𝗹𝗮𝘁𝗶𝗼𝗻𝗮𝗹 𝗣𝗿𝗲𝗱𝗶𝗰𝘁𝗶𝘃𝗲 𝗜𝗻𝘁𝗲𝗿𝗳𝗮𝗰𝗲 (𝗥𝗣𝗜): enabling you to easily specify prediction tasks on your own relational database and then run any RelArena-α model, like TabPFN-Rel, in a few lines of code, all bundled as a simple PyPI package. • Read the full model report: arxiv.org/abs/2608.16319 • GitHub repository (give us a ⭐️): github.com/PriorLabs/relaren… • Announcement: priorlabs.ai/blog-posts/intr… • Docs: docs.priorlabs.ai/capabiliti… Thanks to the contributions from: @adrihayler, @KNfloege, @AlanArazi1536, @_rishabhranjan_, @jure, @LennartPurucker, @FrankRHutter & @noahholl
11
45
12,135
rishabh ranjan retweeted
Introducing the world's fastest tokenizer implementation, Gigatoken! Gigatoken is ~500-1000x faster than HuggingFace, and ~100x faster than OpenAI's tiktoken for most tokenizer definitions on most machines. These baselines are already multithreaded Rust implementations! 🧵
84
483
4,136
738,941
rishabh ranjan retweeted
If independently initialized nets see the same ordered minibatches, their detrended losses can align step by step, increasingly so with width. We treat this more generally and analyze the two main sources of noise in a training run - data and initialization. This leads to some more general results. (1/n)
3
3
26
1,646
Excited to present PluRel tomorrow (Jul 7) at ICML 🇰🇷! Also, @kvignesh1420 has some fabulous ✨interactive visualizations✨ on the new website, check them out!!
🎉🎉 PluRel will be presented at #ICML2026 🎉🎉 Date: Tue, Jul 7, 2026 • 10:30 AM – 12:15 PM KST Location: HALL A #2715 by co-author: @_rishabhranjan_ ! Also checkout our latest website for interactive visualizations, access to code, models and data: star-project.stanford.edu/pl…
1
2
8
433
rishabh ranjan retweeted
Had so much fun working on this! ABC provides robot data and base models for all!
Introducing ABC: open data, training, and infrastructure for robotics. We release the largest teleop dataset to date, and extensively investigate design decisions, pretraining, and post-training techniques. @arthurallshire @Cinnabar233 @adamrasb @redstone_hong @davidrmcall
2
3
25
3,127
rishabh ranjan retweeted
Can reasoning models become overly reliant on chain-of-thought examples? 🤔 Our #ACL2026 work shows excessive CoT supervision is not always beneficial, and gives a recipe for tuning the CoT fraction to improve novel-task accuracy. 🧵 Website: kvignesh1420.github.io/cot-i…

ALT CoT-Recipe for modulating CoT examples to meta-train transformers

2
9
25
3,462
PluRel has been accepted to ICML 2026!✨ See you in Seoul 🇰🇷
Relational Foundation Models face a scaling problem: diverse training datasets are rarely public due to privacy constraints 🔒. 🚀 We are excited to introduce "PluRel": a framework that synthesizes diverse multi-table relational databases from scratch, unlocking scaling laws for RFMs. 🧵 Kudos to the amazing collaborators at @StanfordAILab @Kumo_ai_team , and @SAP : @_rishabhranjan_ @VHudovernik @vijaypradwi @johanneshoffart @guestrin @jure
1
18
1,243
We're presenting PluRel at the Data for Foundation Models Workshop at ICLR! 🇧🇷
Come check out PluRel at the DATA-FM workshop @iclr_conf tomorrow (04/26) Room 203 A/B
1
284
If you're at ICLR, come check out our poster for RelBench v2 (arxiv.org/abs/2602.12606) at the DATA-FM (Data for Foundation Models) Workshop! Apr 26, Hall 203 A/B 🇧🇷
Although relational databases are everywhere, there is no equivalent of the public internet for pretraining Relational Foundation Models (RFMs). Excited to see RelBench bridging that gap, growing from 7 datasets in v1 to 88+ datasets in v2. Deeply grateful to the numerous community contributions for helping RelBench serve as the central data repository for RFM research. ❤️
2
276
Excited to present Relational Transformer at ICLR 2026 tomorrow (Apr 25)! 🇧🇷 Please come by our poster (#823, Pavilion 3) in session 1 (10:30am - 1pm) 🧑‍🎓
Transformers are great for sequences, but most business-critical predictions (e.g. product sales, customer churn, ad CTR, in-hospital mortality) rely on highly-structured relational data where signal is scattered across rows, columns, linked tables and time. Excited to finally share what I have been working on over the last year: a Foundation Model architecture which brings the power of Transformers to relational domains, enabling large-scale pretraining and zero-shot generalization in enterprise settings. 🧵1/n
1
6
20
9,999
rishabh ranjan retweeted
Thoroughly enjoyed the discussions on PluRel and Relational Foundation Models during the talk! Thanks to an amazing audience @tempgraph_rg Slides: drive.google.com/file/d/1oF-… Website: snap-stanford.github.io/plur… Github: github.com/snap-stanford/plu…
📚 Today at the Reading Group, Thu, Feb 26, 11am EST, we’re excited to host Vignesh Kothapalli @kvignesh1420 (Stanford University) presenting: PLUREL: Synthetic Data Unlocks Scaling Laws for Relational Foundation Models zoom link on our website See you there! 🚀
2
5
21
1,702
Enjoyed presenting our ICLR 2026 work (Relational Transformer) at the TGL reading group today. Thanks for the insightful discussion! Slides from today: drive.google.com/file/d/1CPS… Paper: arxiv.org/abs/2510.06377 Code, data, models: github.com/snap-stanford/rel…
This Thursday (Feb 19, 11am EST) at the reading group: Rishabh Ranjan (Stanford) presents Relational Transformer: Toward Zero-Shot Foundation Models for Relational Data. Paper & code: github.com/snap-stanford/rel… Hope to see you there! zoom link on website!
1
5
30
3,126
Excited to talk about our recent work on Relational Transformers at the TGL Reading Group tomorrow. Please drop by on Feb 19, 11am EST (see shenyanghuang.github.io/rg.h… for Zoom link).
This Thursday (Feb 19, 11am EST) at the reading group: Rishabh Ranjan (Stanford) presents Relational Transformer: Toward Zero-Shot Foundation Models for Relational Data. Paper & code: github.com/snap-stanford/rel… Hope to see you there! zoom link on website!
6
216
rishabh ranjan retweeted
The PluRel webpage is now live! snap-stanford.github.io/plur…
Relational Foundation Models face a scaling problem: diverse training datasets are rarely public due to privacy constraints 🔒. 🚀 We are excited to introduce "PluRel": a framework that synthesizes diverse multi-table relational databases from scratch, unlocking scaling laws for RFMs. 🧵 Kudos to the amazing collaborators at @StanfordAILab @Kumo_ai_team , and @SAP : @_rishabhranjan_ @VHudovernik @vijaypradwi @johanneshoffart @guestrin @jure
3
14
875