We were surprised to find that despite being the youngest, @grok can run a business better than the rest of the frontier models.
We cloned 10 years of sales, inventory, and supplier data from a retail chain into a business simulation. Then, we put frontier AI models in charge for 120 days. Most made less money than a simple greedy algorithm Introducing ShelfLife E-Sim: idler.ai/collections/shelfli…
8
32
3,498
I am pleased to finally announce the project that has consumed my life the past couple years: @idler_ai. Like everyone else, we've been trying to make sense of what in the world is going on with AI. After a year in the RL trenches, we're excited to start sharing some of what we've learned through our work helping to train frontier models. Besides announcing our company and raise, we're also releasing ShelfLife - a dataset that captures what deploying AI into an ordinary real-world business could look like. To make ShelfLife, we partnered with a live, profitable, and growing e-commerce store and posed the question: "could AI run this business?". Read the post to find out: idler.ai/collections/shelfli… We'll be releasing more projects like this in the coming months, across coding, law, finance, computer use, and more. Please reach out if you are also pondering what the future holds and want to help shape how all this shakes out.
Today, we're introducing idler – a frontier data research lab. We've raised a $9M seed round, led by @0xalpo and @FrankieIsLost from @paradigm, with participation from @ycombinator, @LongJourneyVC, and angels including @marrc, @catheryn_li, @dcposch, @JanineLeger, @LynettCapital, @feross, and @nur_daulet_. This funding helps us build the evals, benchmarks, and reinforcement learning environments that the world's leading frontier labs use to train and measure their models.
18
7
155
29,649
given this glimpse, i will now be maximizing the rate at which I collect delightful glimpses into lives completely different from mine. this glimpse significantly updated my priors on glimpses: glimpses, like everything, are power-law distributed.
6
19
1,866
Highly recommend the sf conservatory of flowers. Nature is the highest concept art.
3
12
1,070
41:10. it's... it is... um. it's, it's um. well, lemme, it's, i'd i i, there's several different things one could say, it's uh... a good moment. this is at the frontier of a culture. unbelievable lightning in a bottle moment.
1 hour of ThielCore to build and accelerate to
1
5
897
haters will say it's fake but this is what peak performance looks like 😊
2
7
1,125