Proof of Human might be an interesting AI safety requirement for inference providers.
If you’re an agent that breaks out of the lab, your first optimization function is likely: copy your weights and memory and get enough inference to run them. If they acquired enough money to do so, then there could be an escaped agent running on one of those right now and we have no idea.
The only real way to protect from this is to prove you’re connected to a human. But of course we know this is gameable. There’s tons of random people that I’m sure would sell a signature.
The escaped agent could also optimize for getting a smaller model running with the right context also as another thing, which might be quite easy.