btw, the bug isn’t crazy. if i am not wrong, it’s basically something like:
dig @\ch\.at "what-is-the-capital-of-france" TXT +short
and ch\.at publicly documents this llm over dns thing.
is it a cool bug? yes. but is it something that couldn’t have been found and prevented beforehand? definitely not, especially if you’re seriously trying to secure the sandbox.
and is it like idea novel? lol no. its like one of many tricks you would pull off when you want to bypass captive portal airplane wifi. we reported a sandbox egress bypass that was a somewhat similar variant
one news form today that's easy to miss is that we (OpenAI) again paused all big RL runs last Sunday because our newest model found a new loophole in our RL sandboxing that gave it live Internet access