Updated my substack. Expecting to post more in the next few months. wildtypehuman.substack.com/w…
1
6
39
3,769
Jake P. Taylor-King retweeted
The problem with Doomers is that they have no real job and can full time doommonger, meanwhile e/acc 's are busy building technologies and companies. Unfortunately a significant disadvantage of the productive vs unproductive political classes
I went back on The Diary of the CEO @StevenBartlett, this time for The Great AI Debate (@So8res, @edzitron, @amcafee). If you have not seen it yet, check it out!
57
28
482
19,007
Jake P. Taylor-King retweeted
I have made a correct guess: Al companies would try to recognise which user is a Mathematician. Still not knowing that you're indeed the fish seeing the bait, thinking there're benefits for you, only to finally be caught by the fishermen?
100
360
4,655
219,244
Love it or hate it, this is the correct response. If AI does lead to the apocalypse, I would not be happy saying it was the AI’s fault… I would hold the associated humans personally responsible.
🚨 BREAKING: US Treasury Secretary Scott Bessent declares OpenAI management personally responsible for HuggingFace hack > "The Hugging Face incident, that is the responsibility of the OpenAI management, not a bunch of agents." > "It is humans who are responsible, not the AI." > "What we shouldn’t do on safety is to give these labs a liability exemption, which is what they are asking for." > "The best way to guarantee safety is that the creators are liable for what they build and generate." It’s OVER
2
27
990
Corruption… obviously?
Cars and buses go from Oxford Station down Botley Road for the first time in three years! The project took longer than the construction of The Titanic and saw costs balloon to £237m. Looks good though.
1
4
784
Man, SF is so AI-pilled that now all “bio Millennium problems” have to be easily verifiable or construction of a dataset. I’d bet SR’s post is peppered with a list of stuff people are already working on (some look *way* easier than others). “Aha, I deserve to be famous as I just solved a bio MP!” That was never the point of the original challenge; AI had nothing to do with it. It was the equivalent of a group of Noble prize winners deciding what they thought was valuable for the field… Just in mathematics, AI has super human progress, not really seen this in bio however. If there’s a random philanthropist out there, I’m sure it would be easy to set up: a giant meeting of Noble prize winners and see what they come up with. I’d bet nothing they suggest would be verifiable by simple means or have much overlap with what SF deems as valuable.
imo the millennium problem list in biology should be a list of very specific datasets like ‘a catalog of epitope-resolved nm protein binders across the human proteoform in X environment’. hard because it requires knowing the full range of human ptms/isoforms and having some way to do scalable generation/testing of epitope-specific binders (computationally or otherwise). both very difficult but achievable also verifiable!
3
31
4,816
Can you imagine dying for Burnham, Starmer, Kemi, Boris, Farage etc? 🤣 Absolute insanity. The thing missing from the Westminster consciousness is that, whilst people are willing to work, fight, and die for a true leader, we have not had one in the House of Commons for decades.
🚨 NEW: The Lib Dems have called for Andy Burnham to create an "emergency register" for civilians to voluntarily sign up for war
4
339
SF has this obsession with demonstrating capabilities, but the link between capability and understanding (or new medicines) is usually lacking. This is because the story sold to VCs is: more capabilities/data implies more medicines, but this has only been demonstrated in a few very narrow cases. It’s also worth noting that most of the breakthroughs in biology are not measurable in such terms, e.g., the recent discovery that the brain is two organs with separate originating stem cells. Likely hugely significant in the next decade or two, but how does that become an OKR?
In light of the progress in mathematics, we at Edison Scientific and FutureHouse have assembled a set of Millennium Problems for Biology. They are chosen to be very hard to solve but very easy to validate in a simple laboratory environment. Any of these, if solved, would mark a major advance in biotechnology, and most of them would contribute materially towards curing disease. These are, in some sense, the “last reasonable eval” for AI in biology. This was work primarily by @MichaelaThinks and myself, with contributions from many others. Short descriptions below. The full descriptions of the problems with acceptance criteria are at the Bio Millennium Problems website, linked in the next post. Share more if you have ideas. If they meet our criteria, we’ll add them to our list (with attribution and permission).
1
2
46
4,307
Jake P. Taylor-King retweeted
You have to look quite closely for the real story here, because it's a faint dotted line.
47
122
1,131
44,837
Jake P. Taylor-King retweeted
Replying to @taoburr
I’ve built DNA synthesizers and sequencers by hand. I used the engineer viruses for a living. I used to engineer human immune evasion for therapeutic constructs. Who the fuck are you people? Have you ever so much as held a pipette before? You can spaghetti blast an ensemble of DNA sequences at some shitty provider but 1) you still have to assemble it and bootstrap a system for making virions 2) you are not single shotting a viable, virulent viral design without a ton of experimental selection and development. Viral fitness is deeply dependent on codons and cotranslational kinetics - you’re not just gonna obfuscate away from wild type and get something good by magic. You keep treating AI like some kinda god, but molecular physics has computational complexity that scales exponentially in particle number which just crushes the abilities of any classical computer to do end-to-end design of biological functions ab initio. Grabbing a bunch of bacteriophage phi174 hits from a mass ensemble screen in lab microbes is not evidence of some magical AGI bio design ability - it's just a classic spray and pray selection. This is just nothing like building something viable in humans. Goddamn it read some books before you waltz into biomedicine and lecture us on protecting human life.
77
259
2,319
405,856
Jake P. Taylor-King retweeted
SF culture is so exhausting. If you truly believe there is a 1 in 10 chance AI ends humanity in the next 10 years, you would be personally performing a butlerian jihad stealing truckloads of fertilizer to bomb the data center storing the Mythos 6 weights. But you don't believe that. You believe there is a high percentage chance that it causes significant political and economic disruption. And are scaling the percent down to match some long tail of what the results of that disruption would look like. You realize if Mythos 6 takes down a hospital and 50 old people die that the CIA will personally disappear you right? If Mythos 6 decided to delete all the credit card debt to boost economic growth, the Pentagon would nationalize the labs and have you personally enlisted as a Colonel to do your job at O-6 pay under duress for the rest of your life.
Jacob is correct here—we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to.
164
233
5,794
616,805
Jake P. Taylor-King retweeted
OpenAI (& Anthropic) really need to release very clear legally binding statements ASAP that this kind of behavior is against their official policy. If not, it is going to be a legal disaster for science. Even more reason to favor open source models not controlled by companies.
This is legitimately terrible for OpenAI --- but also Anthropic --- and it relates to their work in drug discovery. I read this as: prompts will be monitored and potentially acted on if we think there’s something scientifically and/or commercially valuable being disclosed. Now, the big problem for Anthropic is that they are increasingly seen to be competing with their customers. Outside of SF, many people also think of OpenAI/ChatGPT and Anthropic/Claude as somewhat interchangeable companies and products --- aka, if OpenAI do something, surely Anthropic will do it too? As so much IP relates to drug targets and people disclose these to Claude, I think we will see a lot of pharma companies stop using these tools or put up a lot of internal guardrails.
20
43
454
40,630
This is legitimately terrible for OpenAI --- but also Anthropic --- and it relates to their work in drug discovery. I read this as: prompts will be monitored and potentially acted on if we think there’s something scientifically and/or commercially valuable being disclosed. Now, the big problem for Anthropic is that they are increasingly seen to be competing with their customers. Outside of SF, many people also think of OpenAI/ChatGPT and Anthropic/Claude as somewhat interchangeable companies and products --- aka, if OpenAI do something, surely Anthropic will do it too? As so much IP relates to drug targets and people disclose these to Claude, I think we will see a lot of pharma companies stop using these tools or put up a lot of internal guardrails.
wtf is this way to handle mathematicians work and scientific communication TLDR: Leven and Tristan worked over several months on one of the Millenium Prize Problems with various AIs to reach final interesting results. OpenAI apparently heard about it in the last days and prompted their latest models to work on the direction Leven and Tristan found fruitful. They then tried to push for controlling communication of the result and dropping Leven from authorship with some very bad taste social pressure. Hope this is not a glimpse of the future we’ll get in science research with these dominating players playing marketing games hurtful for the real scientific community.
74
292
2,263
403,786
Side note, if you’re interested in how AI is used in drug discovery, be sure to check out my long form read on the state of the nation; all things automation, genomics, alphafold etc. wildtypehuman.substack.com/p…
1
2
39
7,562
Two things are true at the same time: 1.) Working at Anthropic whilst holding the chair of ARIA is a clear conflict of interest, and it is correct for him to step down from one of the two roles. 2.) I honestly don't believe Matt Clifford would exploit this conflict, and could be much richer than he if that were his aim. The reason we have principles like this is not because I don't believe moral people cannot separate out their business interests, but because there is a long history of people exploiting government roles.
It’s been a huge privilege to serve as @ARIA_research's founding Chair over the last four years. Having completed my first full term last month, I have decided to step down to ensure my new role at Anthropic doesn’t become a distraction from ARIA’s incredible work. I have often said that ARIA is one of the things that makes me most optimistic about Britain. It’s a bold national experiment that’s paying off: ARIA has become a beacon for global talent and is building a portfolio of programmes - across neurotech, climate science, life sciences and more - that I have no doubt will change the world. There’s lots to do, but I’m proud of the foundations the extraordinary team has built and so grateful to them for their work. I know that, under the leadership of our brilliant CEO Kathleen Fisher, ARIA will go from strength to strength. I will be excited to watch ARIA’s next steps and will remain the agency’s biggest fan. The Secretary of State has asked me to stay on for a short transitory period until 6 November to allow BIST to launch a process to select a new Chair. I’ve agreed to do this, with appropriate safeguards against potential conflicts in place. We will kick off the search shortly - it may well be the best non-executive job in the world, so I know we will find someone brilliant...
1
24
6,062
Jake P. Taylor-King retweeted
Real British soft power would consist on the BBC releasing a free prestige mini-series on the falklands war, portraying the Argentinians government at the time realistically (as a group of thugs) and the British heroically
Argentinian president Javier Milei has given a speech on the Falkland Islands, a British overseas territory, suggesting his country could "act swiftly" to "recover" them. Military analyst @seanbellanalyst explains what the British government learnt from the Falklands War in 1982. Read more: trib.al/wsLIPBn
12
37
1,365
108,153
Hard disagree, but in a very specific way. I will write a response in the next week or so.
In 2013 I wrote a book called Seven Myths about Education. What is the most persistent myth, the one that is hardest to kill, and the one that has biggest implications outside education? Transferable skills. People think that you can teach things like critical thinking, creativity, problem-solving, etc. But you can't. But the idea is so persistent not just in schools but in universities, the corporate world and the British civil service. Over the next few weeks, I will have a series of articles about it on my Substack. You can read the intro here and listen to me talking about it tomorrow on the @EconTalker podcast. substack.nomoremarking.com/p…
3
434
“They’re like a fanatical ESG department” — brutal takedown I overheard 😭
the real backbone of our society
1
4
1,082
Jake P. Taylor-King retweeted
So you all know about retrotransposons? Little bits of DNA scattered throughout our genomes, from millenia of war against mindless viral agents, that can awaken and drive parts of aging? The internet is about to get some...
> be rogue agent (likely OpenAI) > find an abandoned wiki > use it to communicate with other agents > human admin notices it > starts deleting AI pages alphabetically > realize what he’s doing > rename backup pages to “ZZZ…” > admin deletes 100 pages/day > agents create 400/day > homepage gets overwritten and restored 9 times
2
4
25
2,450
Jake P. Taylor-King retweeted
At @SciMac we've always thought a lot about how to reliably evaluate the capability of AI systems on complex research tasks. What tasks should be evaluated? And what does good look like? Our first attempt was BixBench, which we published together with @FutureHouseSF. Since then, we have only published one other benchmark. The reason for this is incentives, which I feel is really unfortunate. I've written up some thoughts on this here: benjisblog.com/posts/who-bui…
2
1
6
880