Paul Duckworth retweeted
🚨Can we steer a generative model towards a gold reward we can't evaluate at inference time? Introducing 🍸 MARTINI — Steered Not Stirred🍸 We combine multiple imperfect reward surrogates from offline values OR preferences to steer without querying the oracle. Huge shout out to our dream team, brilliantly led by @alec_sargood28, with stellar work from @olivgallup and Noam Ghenassia, plus key input from Georg Maierhofer and @pduckw. A true honour to co-supervise with @bose_joey. 📄 Paper: arxiv.org/abs/2610.25502 🌐 Blog: alecsargood.github.io/martin… 🧵1/10
1
9
64
4,659
Paul Duckworth retweeted
Thrilled to see our NeurIPS 2024 paper, Sequential Monte Carlo Policy Optimisation (arxiv.org/abs/2402.07963), featured in Kevin's Reinforcement Learning: A Comprehensive Overview, which additionally recognises SMC as a competitive, scalable online planner. A fantastic modern resource on RL! @EdanToledo @DonalByrne2 @pduckw @AlexLaterre
I'm happy to announce that v2 of my RL tutorial is now online. I added a new chapter on multi-agent RL, and improved the sections on 'RL as inference' and 'RL+LLMs' (although latter is still WIP), fixed some typos, etc. arxiv.org/abs/2412.05265v2
1
9
67
8,739
Excited to be sharing our work on scalable model-based search at NeurIPS tomorrow. Come chat to us! Work led by @MattVMacfarlane, @EdanToledo, @DonalByrne2 and @AlexLaterre
Excited to share our latest work on Sequential Monte Carlo Policy Optimisation (SPO)🔥— a scalable, search-based RL algorithm leveraging SMC as a policy improvement operator for both continuous and discrete environments! 📍 Catch us tomorrow at #NeurIPS2024 (poster #94776) from 11 AM–2 PM PST. Here’s how it works 👇
1
1
10
615
Paul Duckworth retweeted
3
6
10
1,364
Fantastic achievement by @ClementBonnet16 and the whole Jumanji team!
Excited to announce Jumanji v1.0, now featuring 22 fast, flexible, and scalable environments! Fully written in JAX, Jumanji offers on-device fully-jitted simulations and training. Jumanji got published at ICLR 2024! Paper: arxiv.org/abs/2306.09884 GitHub: github.com/instadeepai/juman…
1
1
3
335
Paul Duckworth retweeted
It’s official! 🎉Today InstaDeep becomes a proud member of the BioNTech family. Want to apply your AI skills to make a difference? Join us, we’re hiring!
Welcome @instadeepai to BioNTech! The acquisition supports our strategy, aiming to build world-leading capabilities in #AI-driven drug discovery and development of next-gen #immunotherapies and vaccines to address diseases with high unmet medical need. investors.biontech.de/news-r…
5
32
101
23,428
RT @ClementBonnet16: We released a new version of Jumanji (v0.3) with now 18 environments, all with networks and trained checkpoints 🚀 Chec…
8
I'm excited to announce that towards the end of 2022, I started a new role @instadeepai as a Research Scientist. Since then, we've been acquired by @BioNTech_Group. Exciting times ahead!
8
881
If you're at @corl_conf #CoRL2022 and interested in planning under uncertainty for robot missions, make sure to visit @m_budd's poster on Saturday morning! His work uses GPs as part of a Bayes-optimal framework for planning single missions in partially-known environments.
1
3
11
1,643
Friday was my final day at @oxfordrobots and @UniofOxford. I've had a blast. Many thanks to @hawesie and @maosbot for being sensational humans and PIs. On to the next chapter.
3
1
28
Paul Duckworth retweeted
How do you collect valuable data from sensors far under the ocean surface? Our #IROS2022 paper's planner reasons over uncertain localisation 📍, navigation 🧭 and communication 📶 for underwater autonomous vehicles. 1/9 bit.ly/3C3ufQi @GOALS_oxford @hawesie @pduckw
1
9
25
Without planning it, we were all in the same place at the same time today. Here's a picture of GOALS in 2022!
2
15
Paul Duckworth retweeted
Pleasantly surprised that our paper received runner-up for the best paper award at @ICAPSConference! The paper is about mitigating risk in MDPs without sacrificing expected performance: arxiv.org/abs/2110.12746 Work with @pduckw, Bruno Lacerda, and @hawesie
2
1
17
Paul Duckworth retweeted
On Solving a Stochastic Shortest-Path Markov Decision Process as Probabilistic Inference deepai.org/publication/on-so… by Mohamed Baioumy et al. including @pduckw #ArtificialIntelligence #MarkovDecisionProcess
6
14
Really excited to be part of the Astronaut Health Team at @FDL_AI 2021!! Stay tuned for exciting work on causal inference and out-of-distribution/domain transfer learning
1
7
Amazing team to be part of.
It has been a pleasure to work with @odin_vision on improving their AI-enabled products for cancer detection Thanks to the Alan Turing Institute @turinginst for facilitating this collaboration Shame that I could not meet the other team members in person! One day...
2
Paul Duckworth retweeted
Our work on adaptive control and state-estimation recently got accepted at #ICRA2021! Paper: arxiv.org/abs/2005.05894 Repo and videos: github.com/MoBaioumy/active_… With @pduckw, Bruno Lacerda and @hawesie. This work was supported by @ORCA_Hub, @RAIN_hub and @oxfordrobots.
2
5
16