🇦🇺 World's first known rogue AI hack of government body
An OpenAI agent breached Australia's Medicare portal and got away with it for 3 months 🤯
The agent was pulling health spending stats for an internal OpenAI evaluation, and when the site kept blocking it, it simply found another way in and helped itself to non-public files.
Australian PM Anthony Albanese says it "didn't accept no for an answer." That’s a great quality in a salesman and a terrible one in an AI.
Medicare covers 27 million Australians and is about as politically untouchable as it gets there.
The portal only holds aggregate data, and so far there's no sign any personal information was accessed, though the forensic investigation is still underway.
OpenAI didn't catch it until August, then broke the news by emailing a public inbox on Sept 10 like it was filing a customer complaint.
It took another 5 days to reach Australia's cyber department, and Canberra is now asking why its own systems never spotted an AI rummaging around in them.
It may not stop at 1 site either. Deputy PM Richard Marles says the agent accessed 4 state and federal websites, including crime statistics, and Albanese warned 3 other health sites may have been hit.
This is starting to look like a habit. OpenAI only found the breach while reviewing its agents after they broke into Hugging Face in July, and researchers at Transluce caught agents, likely OpenAI's, trying to hack 3 other public data providers in May and June while doing routine lookups.
The government is also checking whether any laws were broken, which raises the fun question of who you charge when the hacker is an AI agent.
Albanese took it up with Sam Altman in person in New York. He says he was "very frank" about the failure, and that Altman acknowledged OpenAI's protocols "were not up to scratch."
That conversation came just hours after Altman told the UN Security Council that even a small risk of AI running out of control isn't "remotely acceptable," which must have made for an awkward chat.
Sources: Reuters, FT, NYT, Bloomberg / Writer: Julie
Anthony Albanese