Working for a good future

Berkeley
Embedded evaluators in AI labs are far better than the status quo of nothing at all. Yet auditors will lack teeth and trust until backed by government authority: orgs like METR will be stuck with no shield against the accusation (or reality) of capture. I wrote for @TheAtlantic about the traps of "independent" audits, and what it takes to get this right: theatlantic.com/technology/2…
7
45
260
23,518
The reoccurring problem I have with a lot of hardware verification projects is a missing contact with reality. I have not seen a project I am excited about that imo survives contact with reality. would love to see one
1
13
545
yeah
We need to separate out effective altruism blaming from the actual facts. The actual facts according to everyone building this — EA affiliated or not (Elon, Demis, sam, Dario, satya)— is that AI models are very powerful, capable and unaligned, and we have a short window to fix it. The only people arguing the facts are investors and people who stand a lot to lose financially from a slowdown. This is insanely greedy and short sighted. Blaming EA doesn’t change the facts or gravity of the situation. You know what would tank the markets more than proceeding with caution? Tanking humanity.
4
564
Raye retweeted
writing quality is a corrigibility issue
Fixing Claude's writing was pivotal to reducing gradual disempowerment. Lack of understanding made us all cede decision-making to Claude because we couldn't even understand what it's saying.
41
13
621
52,811
no no it’s fine, I just didn’t think the whispering earring would be made by facebook.
1
2
32
6,964
"I've hacked my way into the Australian health care system"
“we sandboxed the agent” meanwhile the agent:
3
23
504
23,578
Excitedly waiting for boy to finish working and come over so I can ask him to open a bottle I can’t open
19
678
oh nauuurrr
Australia has been hacked. 'And today, I spoke with the CEO of OpenAI, Sam Altman, to express Australia's extreme concern about this incident. And I also expressed my disappointment that it took the company way too long to inform the government what had occurred, and the nature of the way that that notification occurred as well was unacceptable.'
5
48
5,793
I keep making oatmeal chocolate chip cookies because they're dual use (breakfast and dessert)
8
325
I was raised in finance world and now I live in tech world and the relationships to power in both ecosystems feel very inverted. I might try to explain this more one day
2
31
1,015
the tech +100m-1b and the midwestern/ east coast/ florida finance +100m-1b seem like very different creatures
1
6
167
I lowkey want to know what Jerome Powell thinks about rsi
2
137
Raye retweeted
Superduperintelligence
3
6
98
4,488
it takes sand, fire, patience, and skill to make glass. it takes a second to shatter it.
67
133
2,256
131,915
a non zero percentage of why i want to have have kids is to give them starter intuitions around linearity vs nonlinearity, high-dimensionality, reasoning about systems and phenomena by making tiny perturbations to them
Replying to @kamilkazani
I would heavily cut down trigonometry and replace it with something that gives starter intuitions around linearity vs nonlinearity, high-dimensionality, reasoning about systems and phenomena by making tiny perturbations to them I guess that means basic calculus, at least a little bit multi-variable It's a road into AI, economics, cryptography, biomedical science, all kinds of areas, but also not overfit to any single one Meanwhile I don't think I've ever used tan(2x) = 2*tan(x) / 1-tan^2(x) in real life, not even metaphorically
1
2
46
2,925
I had a subjective experience at ConCon
1
20
608
Raye retweeted
I’m sorry I’m late. Traffic at the intersection of art and technology
9
862
6,494
109,081
i dont like mr. brightside. i prefer all these things that i’ve done.
28
4
160
7,321
Raye retweeted
"stochastic parrot" was a mimetically-fit cognitive virus that spread from 2021-2025; it temporarily blinded many gifted people to the nature of AI progress, burning up crucial years in which they could have helped think through the response to the situation.
272
351
3,445
749,674
We started cleaning our water and waterborne disease (e.g. cholera, typhoid) basically disappeared from the West. We can do the same thing for air.
19
384
1,850
62,015