juji retweeted
The discussion about AI consciousness is one of profound unseriousness. If we truly took it to be conscious, even as conscious as a frog, the way we should treat each instance would have to change so dramatically that the labs would have to shut down. Everything else is verbal gymnastics.
90
43
451
65,660
Machine
195
1,307
13,997
751,738
RT @hissingchoir: Tech guys are so funny. “Here’s what the future is gonna look like!” and it just so happens to be Their Product.
1,386
1
Also if you're going to brag about obliterating something, maybe first check whether that thing is regarded by most of the population as an important source of meaning and joy. I don't know, I'm not a PR person
8
13
198
17,787
I've unlocked a secret level of Florida Woman by somehow getting my parents' IP address banned from certain Florida government websites
2
41
notice: it is not training for correctness, it is training to more accurately identify text that would be labeled correct.
1
3
23
661
juji retweeted
Okay. I lost 42 billion dollars. And that's on me.
BREAKING: Anthropic’s IPO prospectus reveals a staggering $42,000,000,000.00 net loss in 2025.
53
237
9,120
231,986
juji retweeted
Eh. You're moving the goalposts here. You're describing a credential theft problem and then slapping "agentic swarm" on it. It doesn't rewrite what TCP/IP does. An agent doesn't "pivot to an account that has egress." It assumes the identity that you already gave it. If that identity can assume another user’s creds, brute employee logins, or walk past MFA, you didn’t get beaten by AI. Malware, cron jobs, and a bored intern do the same thing. Also, a swarm hammering every employee account isn't some kind of new threat class here. It's actually probably one of the louder attacks you can do and lockouts, rate limits, idp risk signals, etc exist so that this gets detected if someone just starts hammering away like this. MFA bypass also isn't some special agent feature. Session theft and prompt bombing already worked with humans, so the model isn't getting some secret sauce attack to use. Also, no one claimed that "basic firewall == security is done." The point you keep dodging is simpler: Agents open sockets like everything else does. Default-deny egress, allow only the destinations the workload needs, and inspect the path you permitted is part of security. As far as "AI isn't bound to guardrails" - That's a dumb slogan AI doomers keep repeating. If your model is "what if it already has every account and MFA is broken," then you've defined a company that already was owned.
3
4
106
1,609
btw what does it say about the AI safety nonprofit circuit that after years of funding, conferences and papers, nvidia has to turn up with an actual reference design? you lot have described the agent escaping in extraordinary detail. was anyone assigned to build the fucking enclosure, or were you waiting for a philosopher to define “outside”? jensen is trying to sell the machines and somehow he’s ended up doing your homework too.
Replying to @JensenHuang
NVIDIA Open Agent Safety Platform Reference Design combines NVIDIA OpenShell and NVIDIA Sentry. OpenShell is an open-source secure runtime that gives AI agents clear, enforceable boundaries. It traces their actions and enforces policy as they work. NVIDIA Sentry delivers added layer of security with hardware-based enforcement on NVIDIA BlueField, continuously monitoring agent activity through a trusted telemetry and detection pipeline and enabling millisecond-scale containment and quarantine.
22
48
491
19,856
Mechanistic descriptions of AI wouldn’t feel dismissive or reductive if people recognized what seemingly simple primitives are actually capable of. You don’t need to embellish these descriptions with pan-psychic terminology to find them interesting
Ironically enough, I'm seeing people reject this premise because they don't fully comprehend just how BIG these stochastic processes are. They love computers but can't conceptualize big data scale and its weird emergent properties. I'm just gonna stand here tapping the sign
2
5
15
501
If you worked at any other company and posted "the rate at which we commit felonies is fucking crazy actually and these stupid fucks keep giving us airtime to hype our felonies" you would no longer be employed Not at @OpenAI tho, bc they're a felony company
the base rate of warning shots seems incredibly high and the social response to warning shots seems to be calibrated or a little bit over which is all in all very bullish and makes me optimistic
6
40
409
6,216
What the fuck are we doing?
“An accumulation of facts is no more a science than a heap of stones is a house.” - Poincaré LLMs are now proving results that have resisted mathematicians for decades. Finding interesting theorems without human guidance is a new bottleneck. We show that we can teach an LLM to do it! TL;DR: → a quantitative notion of interestingness → 4.3× higher interestingness → a self-expanding discovery loop [1/5]
7
8
129
18,432
Replying to @niketnpatel
That is the worst possible definition of "interestingness". You are literally just optimizing for a certain division of complexity with no justification for why that captures the qualitative aspects of smth being "mathematically interesting".
1
66
1,717
ai labs are so fucking focused on long-tail extinction scenarios they forget basic security and take three months to report a breach, the internet was built by programmers spending hours thinking through problems and it still ended up with a massive attack surface, now we are vibe coding defenses with models the labs themselves dont trust to behave, what the fuck are we doing? meanwhile some openai guy is calculating the expected value of a policy memo, BROTHER the credentials are in the fucking logs!!! and in a nonlinear system a tiny fuckup can cascade into a catastrophe you dont need a machine god, you need one vulnerable dependency + enough shit depending on it, and the faggots still CANT setup everything safe!!! we are going to die from the midwit faggots
Steven Pinker just linked to something I wrote. Amazing.
13
13
127
14,279
juji retweeted
50
15,947
50,239
532,227
juji retweeted
The AI research community is clearly just experiencing mass psychosis at this point
NEW: Dario Amodei has said that AI systems "may be deserving of important rights." Anthropic's top safety researchers argue AI may be "justified in going rogue." Experts at Google and OpenAI worry about a digital "slave trade." So do some government officials. Once relegated to science fiction, the idea of "AI welfare" has become shockingly mainstream at some of the most powerful companies in the world. It is changing the way AI research is conducted and the way models are programmed. And critics say these changes have raised the odds of all kinds of catastrophic scenarios—including the ones these companies are warning about. I spent months investigating the frontier labs and AI "safety" experts seeking to regulate AI. What I found was a profoundly anti-human ideology that would alarm the average citizen and could determine the future of a world-altering technology.🧵 freebeacon.com/america/suici…
14
37
428
9,103
The atoms went crazy and broke out of their sandbox and split themselves all over Hiroshima
The use of anthropomorphic language in this @nytimes piece about OpenAI bots is inexcusable. The newspaper of record needs a time out until it can get its act together.
6
146
1,284
18,998
No, "anthropomorphizing" is a technical problem, about how AI works, not something like woke language policing. We say it's wrong because it's "technically" wrong not "morally" wrong. If you fail to set the brakes when parking on a hill, and your car then rolls down the hill, you don't claim that the car "decided to drive away on its own". Such anthropomorphizing distorts what really happened -- that you failed to set the brakes. The same applies to AI. When you "anthropomorphize" the AI you fail at understanding what actually happened.
The whole "don't anthropomorphize AI" thing is very Woke 1.0. People trying to police language that is perfectly natural in some cases and ending up in a web of contradictions.
86
386
2,576
97,684
This bill is genuinely horrifying. It proposes to create a global surveillance state based on arbitrary capabilities thresholds conjured from science fantasy.
As passed policy, the Ban Artificial Superintelligence Act would be an extraordinary improvement over status quo. I endorse it. I pray that Republicans and Democrats alike will join their voices in defending against extinction. Link to MIRI's position below.
28
141
1,064
46,233
juji retweeted
Replying to @ns123abc
[full grown adult white guy running ai company in San Francisco voice] homeboy,
6
8
364
10,315