Reverse-engineering a game binary is impressive, but why assume that means the same model can compromise banking systems, Aadhaar infrastructure, or airline/flight systems?
A game binary is distributed to the user and runs locally. Critical banking, Aadhaar and airline infrastructure is generally server-side, with authentication, authorization, network segmentation, encryption, monitoring, rate limits and other controls.
And "Claude refuses to tick Im not a robot so we’re protectet" is also a weak security argument. Model refusals add friction, but they aren't the security boundary. An unrestricted OSS model could potentially make browser automation, vulnerability research and attack workflows cheaper and more scalable.
The real question is, can AI reliably automate the full chain from vulnerability discovery -> exploit development -> attack-chain construction ->execution?
If yes, that’s a serious cybersecurity problem. But why jump from "AI can reverse-engineer a game" to "banking, Aadhaar or flight systems are compromised" without demonstrating those intermediate steps?
I've done a complete U-turn on my opinion on open source AI. We should be careful (and probably disallow release) of models on par with current open source Astra/Opus level models.
AI is now reverse engineering games from binaries and remaking them. Reverse engineering games is a very hard problem. If this is possible then reverse engineering banking software, ID systems (Aadhaar), flights, etc is possible too. A game ships its binary to every player. Bank and Aadhaar backends are protected by servers, but it's unlikely the security teams at these are smarter than advanced AI that can do this to games.
We are protected rn because a Claude will refuse to tick "I'm not a robot" on websites. When OSS models don't respect that, we have a looming cybersecurity problem. Apologies I didn't see this earlier.