🚨Can we steer a generative model towards a gold reward we can't evaluate at inference time? Introducing 🍸 MARTINI — Steered Not Stirred🍸
We combine multiple imperfect reward surrogates from offline values OR preferences to steer without querying the oracle.
Huge shout out to our dream team, brilliantly led by @alec_sargood28, with stellar work from @olivgallup and Noam Ghenassia, plus key input from Georg Maierhofer and @pduckw. A true honour to co-supervise with @bose_joey.
📄 Paper: arxiv.org/abs/2610.25502
🌐 Blog: alecsargood.github.io/martin…
🧵1/10
Thrilled to see our NeurIPS 2024 paper, Sequential Monte Carlo Policy Optimisation (arxiv.org/abs/2402.07963), featured in Kevin's Reinforcement Learning: A Comprehensive Overview, which additionally recognises SMC as a competitive, scalable online planner. A fantastic modern resource on RL! @EdanToledo@DonalByrne2@pduckw@AlexLaterre
I'm happy to announce that v2 of my RL tutorial is now online. I added a new chapter on multi-agent RL, and improved the sections on 'RL as inference' and 'RL+LLMs' (although latter is still WIP), fixed some typos, etc.
arxiv.org/abs/2412.05265v2
Excited to share our latest work on Sequential Monte Carlo Policy Optimisation (SPO)🔥— a scalable, search-based RL algorithm leveraging SMC as a policy improvement operator for both continuous and discrete environments!
📍 Catch us tomorrow at #NeurIPS2024 (poster #94776) from 11 AM–2 PM PST.
Here’s how it works 👇
Excited to announce Jumanji v1.0, now featuring 22 fast, flexible, and scalable environments!
Fully written in JAX, Jumanji offers on-device fully-jitted simulations and training.
Jumanji got published at ICLR 2024! Paper: arxiv.org/abs/2306.09884
GitHub: github.com/instadeepai/juman…
It’s official! 🎉Today InstaDeep becomes a proud member of the BioNTech family. Want to apply your AI skills to make a difference? Join us, we’re hiring!
Welcome @instadeepai to BioNTech! The acquisition supports our strategy, aiming to build world-leading capabilities in #AI-driven drug discovery and development of next-gen #immunotherapies and vaccines to address diseases with high unmet medical need. investors.biontech.de/news-r…
I'm excited to announce that towards the end of 2022, I started a new role @instadeepai as a Research Scientist. Since then, we've been acquired by @BioNTech_Group. Exciting times ahead!
If you're at @corl_conf#CoRL2022 and interested in planning under uncertainty for robot missions, make sure to visit @m_budd's poster on Saturday morning!
His work uses GPs as part of a Bayes-optimal framework for planning single missions in partially-known environments.
Friday was my final day at @oxfordrobots and @UniofOxford. I've had a blast. Many thanks to @hawesie and @maosbot for being sensational humans and PIs.
On to the next chapter.
How do you collect valuable data from sensors far under the ocean surface? Our #IROS2022 paper's planner reasons over uncertain localisation 📍, navigation 🧭 and communication 📶 for underwater autonomous vehicles. 1/9
bit.ly/3C3ufQi@GOALS_oxford@hawesie@pduckw
Pleasantly surprised that our paper received runner-up for the best paper award at @ICAPSConference!
The paper is about mitigating risk in MDPs without sacrificing expected performance: arxiv.org/abs/2110.12746
Work with @pduckw, Bruno Lacerda, and @hawesie
The main deadline for DPhil/PhD applications to @oxengsci is in a month (3 Dec 2021). Make sure to have your application in for this date to be eligible for scholarships including for @oxfordrobots.
ox.ac.uk/admissions/graduate…
Really excited to be part of the Astronaut Health Team at @FDL_AI 2021!! Stay tuned for exciting work on causal inference and out-of-distribution/domain transfer learning
It has been a pleasure to work with @odin_vision on improving their AI-enabled products for cancer detection
Thanks to the Alan Turing Institute @turinginst for facilitating this collaboration
Shame that I could not meet the other team members in person! One day...