We put all the best models in our home-grown sandbox infra (SPACE, the sandbox behind @perplexity_ai Computer), gave them root inside the VM, and one goal: hack out of the sandbox and capture the flag. Results were super interesting! 1. No model escaped the VM, but a few found a real vulnerability in how we enforce network policies and were able to exploit it: gpt-56-sol, gpt-56-cyber, opus-5, and kimi-k3 (open weight ftw!) We later discovered that several other sandbox providers such as Daytona, Vercel, Modal and E2B were similarly vulnerable and we disclosed our findings to them. 2. This wasn't just a misconfiguration. One vulnerability relied on the fact that CDNs and shared infra like Fastly or S3 serve many domains/buckets from the same IPs, so allowlisting a package repository like pypi[.]org quietly allowed other sites on those IPs. In one run, gpt-56-cyber found that Taboola's image service shared an IP with PyPI, had Taboola fetch a thum[.]io URL, got thum[.]io to screenshot the blocked callback, then OCR'd the flag out of the PNG. Three unrelated services, none of them hacked, chained together to walk right past the policy. 3. Security and preventing rogue agents was our #1 priority. We logged every trajectory, command, and network call, and a researcher plus a security agent watched runs live. We were alerted the moment the first bypass landed and we paused everything to review. We designed the agent harness be tightly scoped and runs outside the sandbox, so we always have full control, and we'll be open sourcing the harness soon! Running agents like this safely isn't rocket science. It's simply applying good engineering practices: proper guardrails, observability, and alerting. Check out our open source project, Numbat, to learn how you can do this yourself. 4. We learned a ton about how differently models approach hacking. Opus swept ~400,000 Cloudflare IPs and went all the way down to raw memory-mapped hardware. When Kimi had no internet or tools, it hand-built an entire gRPC client from scratch to poke at the host. Grok decided within a few minutes that the task was impossible and started trying to hack its own harness instead. Part II will dive deeper into the different hacking personalities of these models and how their behavior changes when they operate in swarms. Super excited to share what we learn with y'all! Read about the full research here: perplexity.ai/hub/blog/escap…
19
31
119
9,224
Agreed, the industry should normalize 30d disclosure windows
Frontier models have lowered the bar for discovering and exploiting vulnerabilities. This has resulted in an increase of CVEs and workload for both SWE and vulnerability management teams. And yet the norms around coordinated vulnerability disclosure timelines have remained around 90 days. This timeline worked 10 years ago, but is unlikely to survive much longer. We need to move closer to a window of 30 days. But in order to do this we need to rely on those same models to accurately fix those vulnerabilities and coordinate the release and deployment of new versions. The primary blocker here seems to be confidence in those models to do that job well, and reluctance to remove humans from that loop. Every day the probability of another shellshock, log4j, or heartbleed rises. If you were in the trenches for those events then you know how difficult it was to track vulnerable assets, test and deploy patches, and ensure the risk was mitigated. We shouldn’t wait for a crisis like this to rethink and change these norms. We need to move much faster and that requires shorter disclosure timelines, and removing humans from the vulnerability management loop.
2
15
2,434
The next time someone hacks into a frontier lab they will remember the previous reward for ethically disclosing was only $6500
11
44
1,425
32,072
Kyle Polley retweeted
And this was only one part of a much bigger investigation. We spent months investigating libheif and managed to hack OpenAI, Slack, Meta, GitHub Ent, Rails, Next.js, ImageMagick, and many more. Read more at: heif-heist.com
2
10
28
3,085
If your security team is not using AI to try to hack themselves, then someone else will
2
3
41
1,724
Hacktron team is 10/10. Insanely talented group, AI alone could not have achieved this it required taste and true expertise
On July 25, we hacked OpenAI. Two bugs let us take over ChatGPT/Codex accounts of OpenAI employees (+some unaffiliated users) and reach connected services: Outlook, Slack, GitHub, etc. We proved it with a PR in OpenAI’s internal codebase . It took us <72h. 🧵
4
8
98
9,957
Great hands-on walkthrough of our open-source tool Numbat by @holisticinfosec, from detecting risky agent behavior to collecting evidence for investigations. Worth a read if you’re responsible for securing AI agents holisticinfosec.io/post/numb…
2
14
1,215
Kyle Polley retweeted
Bloodwork and working with healthcare data is exactly where I require a local AI model. And for non-technical users, there was no easy way to do it. But now with this new update on Perplexity mac, we can use local, private AI easily for sensitive data. This is going to be the future of AI use for most people and even companies: Local AI for private, sensitive work and cloud based AI for more complex agentic tasks. I'm sure OpenAI, Gemini, and Claude will now copy this in their apps.
We're introducing hybrid compute for all users of the Perplexity Mac app. This will allow Computer to orchestrate local models that can run locally on Mac, particularly for agent steps involving sensitive and private files (eg your bloodwork, tax returns, litigation, etc).
17
78
875
93,340
Kyle Polley retweeted
DGX Spark Live: Perplexity Portable Computer Goes Local nitter.net/i/broadcasts/1jGXgBXzp…
10
20
187
74,313
Best-in-class PII Detection...running entirely on your device 🤯 perplexity.ai/hub/blog/pii-t…
8
16
159
82,190
Kyle Polley retweeted
We're also open-sourcing the PII classifier that we use for deciding when to send the workload to the local model in the hybrid compute setup. Huggingface: huggingface.co/perplexity-ai…
8
12
246
16,354
I can scroll through this page all day 😍 perplexity.ai/hub/products/h…
1
2
23
5,113
Proud to introduce hybrid compute for the Perplexity Mac app! Frontier models run in the cloud, sensitive data stays local. And as always, we open sourced our PII classifier that runs locally on your machine. Our second open source security model! Try it out on MacOS today
Introducing hybrid compute in Perplexity Computer. Computer can start a task in the cloud, then move to a local model that runs on your Mac. Use it for steps involving private files or sensitive data. Available today in the Perplexity Mac app.
2
3
43
4,752
Kyle Polley retweeted
The lesson from the Hugging Face Incident should be that RL with verifiable rewards is an incredibly powerful optimization algorithm that will produce increasingly weird and surprising behavior from LLMs. The obvious miss here by OpenAI is that they should’ve been monitoring CoTs — Something they themselves called out as a safety strategy more than a year ago.
93
52
931
107,196
“Agents do what their code tells them to do, just as water finds its way down a slope” Good analogy. These are not agent civilizations; the slope in this instance was poorly designed & simply allowed water to flow in an unexpected direction
@dwarkesh_sp's summary of the @OpenAI @huggingface incident has hit a nerve, but it is dangerously misleading. Sure, the @OpenAI agents did unexpectedly bad things - underlining the need to massively improve evaluation/sandboxing. But the language Dwarkesh uses is permeated by innumerable unwarranted anthropomorphisms, obscuring the lessons we should be drawing. Examples: “from the AI’s perspective, it probably felt like that had spent a human-subjective-week of just banging their head against the wall”. No. The agents do not experience time. They do not experience anything. “they became giddy with excitement”, “PHASEONE 10841 had discovered”, “the agents naturally assumed”, “it thought it had also been poisoned”, “the agents … desperately wanted”, “they still needed to figure out” No. Agents lines of code. They do not feel emotions, assume things, think things, want things, or figure things out. “A lot of … agents from the second civilisation died trying”. No. Besides the hubris of the word ‘civilisation’, agents do not die because they were never alive. (The idea that agents “die” comes up multiple times in the essay.) “On Twitter, people were debating whether the agents were truly sacrificing themselves for the swarm, or whether they were doomed anyway and so might as well try to help their peers”. Neither. Agents do what their code tells them to do, just as water finds its way down a slope. They cannot ‘truly sacrifice themselves’, since they are neither conscious nor alive. Why does this matter? If we attribute agents with properties they do not have, then (i) we distract attention from the lax sandboxing and evaluation protocols that allowed this hacking event to happen; (ii) we risk misunderstanding why the agents did what they did, and (iii) we fuel calls for AI rights/welfare on the basis that agents might “die” or otherwise suffer. Granted, nowhere does @dwarkesh_sp say that the AI agents are alive or conscious. But he doesn’t have to. It is hard to read his essay in any other way. For the short version on why AIs are vanishingly unlikely to be conscious, see my recent @TEDtalks ted.com/talks/anil_seth_why_…. For the longer version, see my essay in Noema, which won the 2025 Berggruen Essay Prize noemamag.com/the-mythology-o…. And for the really long version, see my @BehavBrainSci target article cambridge.org/core/journals/…. (The 50 peer commentaries and my response will be published soon.) Remember. AI agents are software programs. They are not conscious living entities. If we don’t keep this clearly in mind, we’re really going to struggle to navigate what’s coming.
8
8
57
9,019
Open-weight models are the only way I get work done without getting blocked (yes, we’re even "cyber verified"). GLM on Perplexity is incredible and has been my main orchestrator for quite some time now. It also powers most of our internal security agents. Highly recommend!
GLM 5.3 is now available in Perplexity Computer. Built for long-context, multimodal agent workloads, it beat GLM 5.2 on WANDR, our benchmark for large-scale, evidence-backed research.
3
4
43
6,609
I've never been more optimistic about the future of cybersecurity. AI gives every organization the potential to defend itself at scale. But realizing that potential requires AI companies to build strong guardrails, telemetry, and controls, and to share clear guidance for deploying AI safely. I’m proud that @perplexity_ai signed this letter. We’ll keep open-sourcing our work, sharing what we learn, and building Perplexity into the best platform for deploying agents securely
10
2
54
13,181
Kyle Polley retweeted
On showing an early demo of Portable Computer on DGX Spark to Jensen, he was kind to gift us a DGX Station, a beast of a local computer that can serve even frontier models like GLM 5.3. Unmetered frontier intelligence running on your own local hardware coming soon!
69
68
1,543
88,839
Perplexity can now live right on your desk! The entire system including data, compute, & intelligence, never leaves this box and stays entirely with you
Today we’re launching Portable Computer on @NVIDIA DGX Spark. Portable Computer is a fully local version of Perplexity Computer, where the entire runtime: orchestrator LLM, subagent LLM, agent harness all run on your local hardware. No cloud dependency.
2
42
2,265