ICLR is ... not in good shape in terms of harnessing AI for academic review Good day to check out @RefineDotInk
XY Han
@XYHan_
Sep 16
Just learned that the Paper Assistant Tool (PAT) that ICLR uses for auto-generating llm-reviews is powered by Gemini 2.5 Deep Think. To which I respond: What makes Gemini 2.5 DT believe it's qualified to judge the paper I wrote with Fable 5.1 Max and GPT 6 Astra Ultra?

Sep 22, 2026 · 1:00 PM UTC

2
2
34
6,045
Sort replies: Relevant Recent Liked
Replying to @ben_golub @RefineDotInk
The review we received was helpful and detailed FWIW! It did wrongly point out one math flaw (was worried we double counted) but it's the kind of thing we'd want to guard against misinterpreting.
1
5
222
Yeah, I think you could have made a pretty good reviewer based on Gemini 2.5 pro! I'm just surprised by this being the stack at this stage of the game.
2
81
Replying to @ben_golub @RefineDotInk
I remain at such a loss for getting academics caught up on where AI really is right now I've been doing almost nothing but teaching peers for the past six months, even open-sourcing my workshops, and 99% of academics are still so far from understanding even basic orchestration
3
82