sisyphus bar and grill retweeted
[🚨 nerd alert] Sometimes you just gotta entertain yourself by building your own world model (and policy, and game env).
In this project, the world model is the backbone of the policy head, but the policy head is also trained on the generations of the world model. It's a fun showcase of imagination training and memory-necessary gameplay, if I do say so myself. By memory-necessary, I mean the policy needs to remember previous observations to accomplish its task (e.g., being instructed to "turn right in 10 units" at time t_a requires remembering how many units you've driven thus far at time t_b). And it's also cool that the world model and policy share most of their weights!
Keep a lookout for the accompanying article at the @AmplifyPartners blog! This'll be the sequel to "a brief history of learning in imagination" (check out my post on it in my profile if you're curious).
Btw, you can play with this yourself! You can drive **in** the trained world model (i.e., city generated by the world model), and/or watch the policy drive automatically, all in my website. Or if you're basic (jk), you can also play in the real environment (it's always good to know the baseline).
kota-wm repo: github.com/xyntechx/kota-wm
my website: xyntechx.com/
[works best with webgpu]
Creds: I took some code from minGPT @karpathy and IRIS @micheli_vincent @EloiAlonso1 @francoisfleuret @gen_intuition -- thank you to the authors!
✨ If you've made it this far, hi! I'll be at Runtime organized by @modal on Oct 1. If you're building in AI x games (including game-playing and game-making agents), DM me and let's meet up!
2
3
6
402
the toasted everything with butter at Apollo is $4. But there are some days where I think I'd be willing to pay $20, maybe even 30
3
9
1,358
no whales were harmed in the making of this podcast.
Human-animal communication? Life on other planets? Alien priests? Once again back trying to bring a more eclectic discussion of the future to the internet with a new series of Forecast 2050.
Thanks to David Gruber (@ProjectCETI), Gen. David Petraeus, Patrick McGee (@PatrickMcGee_), Yi-Ling Liu (@yilingliu95), Laura Kreidberg (@lkreidberg), (@mpi_astro), Walter Goodwin (@fractile_ai), Sir Robin Saxby, Francesco Sciortino (@proximafusion), Adrian Woolfson (@AdrianWoolfson), Frank Fukuyama (@FukuyamaFrancis), and Father Brendan McGuire for joining us.
First episode with Father Brendan McGuire, Catholic Priest & External Advisor to Anthropic’s Claude Constitution, drops on Thursday.
More to come!
1
5
1,452
Where do guys sell used clothing/shoes?
I have an unworn pair of Aldens I can't return but feels like the wrong item for Grailed
9
1
3,409
I've completely switched over from gels to nerds gummy clusters for running. I am increasingly thinking gels are basically a scam from Big Running to give you expensive marked up sugar
101
35
4,712
524,689
Ranking top devtools and infra mascots:
1) @github octocat
2) @turbopuffer puffer fish
3) @posthog hedgehogs
4) @exedev blowfish
5) @AntithesisHQ anteater
6) @TigerBeetleDB beetles
7) @digitalocean sammy the shark
8) @ClaudeDevs clawd
9) @bunjavascript bun
999) PHP elephant
25
1
66
9,528
