I co-wrote this RL environment FAQ with @datagenproc from @EpochAIResearch:
Frontier labs are investing massively in RL environments, yet most of what happens in this space stays behind closed doors. @chrisbarber and @js_denain interviewed 18 people from RL environment startups, neolabs, and frontier labs. Here's what they found:
4
5
126
82,784
I asked people which data companies influence research direction at the frontier: 16 votes: Surge (@echen) 13 votes: Proximal (@calvinchen, @MatternJustus) 8 votes: Preference Model (@jennifgcrl, @Ning_Catsnail) 7 votes: Datacurve (@serenaa_ge, @charleyslee) 6 votes each: - Mechanize (pre-acquisition) (@tamaybes, @EgeErdil2, @MatthewJBar) - Mercor (@BrendanFoody, @adarsh_exe, @suryamidha) 5 votes: Fleet (@nicoup, @andrewthezhou) 4 votes each: - AfterQuery (@CarlosGeorgescu, @spencermateega) - Prime Intellect (@vincentweisser, @johannes_hage) 3 votes: Latch (@AlfredoAndere, @kenbwork, @kylegiff) 2 votes each: - Abundant (@huyouare, @kehuangsf, @meji_abidoye) - Artificial Analysis (@_micah_h, @grmcameron) - Bespoke Labs (@madiator, @AlexGDimakis) - micro1 (@aliansarinik) - Terminal-Bench (@Mike_A_Merrill, @alexgshaw) 50 people voted. People couldn't pick a company they work at or founded. Disclosure: on this list, I'm a small investor in Abundant, AfterQuery, Arcanum, DLR, Fleet, Latch, Paper Instruments, Snorkel, and Vmax. I didn't vote. Continued:
13
18
280
44,418
Preference Model corrected usernames: @chem_safety and @Ning_Catsnail
2
689
I asked 51 people in AI who has a good read on RSI (recursive self-improvement) and where it's going: 5 votes: - Jerry Tworek, Core Automation (@MillionInt) 4 votes: - Jun Park, Hillclimb (@jparkjmc) 3 votes each: - John Schulman, Thinking Machines (@johnschulman2) - Rohan Anil, Core Automation (@_arohan_) - Daniel Chang, ex-Mercor (@dnnssl2) - Laksh Aithani, Abundance (@LakshAithani) - Richard Socher, Recursive (@RichardSocher) 2 votes each: - Andrej Karpathy, Anthropic (@karpathy) - Behnam Neyshabur, Mirendil (@bneyshabur) - Han Fang, Meta Superintelligence Labs (@Han_Fang_) - Herbie Bradley (@herbiebradley) - Jennifer Zhou, Preference Model (@chem_safety) - Paul Christiano, Alignment Research Center (@paulfchristiano) 75 people were picked. The other 62 got 1 vote each and are in the next posts. 51 people voted, each picking from people they've met. I didn't vote.
27
35
504
106,026
Chris Barber retweeted
Yesterday we hosted Convergence: RL Summit bringing together researchers, industry leaders, and operators to talk about the frontier of model development and where things are going.
9
10
50
5,297
I asked 36 people in AI who to talk to if you're selling a private dataset, like a shut-down startup's data: 19 votes: micro1 (@aliansarinik) 9 votes: Mercor (@BrendanFoody, @adarsh_exe, @suryamidha) 5 votes each: - Handshake (@GarrettLord, @benmchristensen, @scottringwelski) - SF Data (@brandonguo, @faizsiddiqii) 4 votes: Surge (@echen) 3 votes each: - AfterQuery (@CarlosGeorgescu, @spencermateega) - Ooak Data (@PLouisV, @ThomAub, @adeRL_g) 2 votes each: - DataVendor (@seeklis, @parth220, @jayendra_ram) - Grepped (@eriknewsha) - Nyne (@michaelfanous1, Emad Fanous) - Standard Data 36 people voted. People couldn't pick a company they work at or founded. Grepped received one negative vote as well. Disclosure: on this list, I'm a small investor in AfterQuery, Fleet, Ionic, Nyne, Ooak Data, Patronus, and SF Data. I didn't vote. Continued:
39
32
434
79,863