Director @UGI_at_UCL. Interest in Infectious disease epidemiology, pathogen genomics, global health, and all sorts of other stuff.

Settling in
Our über-massive review on everything you always wanted to know about SARS-CoV-2, or didn't even know you wanted to know, or would have preferred not to know - but if you read it you'll know it (sorry), is out, peer-reviewed and open access. academic.oup.com/ooim/advanc…
102
233
905
The biggest concern to me here is the total lack of editorial oversight of many news outlet. Professionally edited commissioned articles go through many iterations and multiple back and forth between the author and the editors. There is no way a properly edited article gets flagged as >30% AI generated, if the sub-editor and senior editor do their jobs, even if the initial draft was 100% AI slop.
1/12 John Spencer (@SpencerGuard) is known for misrepresenting the ratio of civilians to combatants killed in Gaza, among his other crude apologetics on behalf of the IDF. His lying doesn't stop here. He has LLMs write entire articles under his name. It's 🧵 time!
2
13
95
9,764
Moral panics have always recruited the language and institutions of consensus. This is true for European witch hunts, the Spanish Inquisition, Blood libel and anti-Jewish pogroms, the Chinese Cultural Revolution, McCarthyism, the Satanic Panic and any other major moral panic I can think of. Given the idiocy of past moral panics throughout history, the case for people getting "stupider and more emotionally dysregulated" feels weak, to say the least.
People becoming stupider and emotionally dysregulated has all sorts of implications. For example, moral panics are now regularly confused with intellectual and cultural consensus.
2
1
26
4,660
If I were American, I would probably feel embarrassed (and slightly concerned) that my arch-enemy's politicians come across as so much more educated, intelligent and informed about economics, than my own president.
42
106
873
75,500
There are two (not necessarily mutually exclusive) ways to read this poll. Either Americans are more politically mature that one may have anticipated or most are sufficiently well off that $5000 would make no material difference to their finances.
New - $5,000 Trump dividend 🟤 Oppose 63% 🟢 Approve 17% Ipsos - A - 9/14
5
2
25
7,097
Arguably one the nerdiest troll accounts on 𝕏 ...
Straits Taylor Rule: i = r* + π* + 1.5(π−π*) + 0.5(y−y*) + α(SOH−SOH*) + β(BEM−BEM*), α,β > 0 Let’s see if a hike could open SOH or produce a single barrel :) You can’t 25bp a chokepoint and r* isn’t neutral. It’s SOH risk premium, and We set it. Stay unanchored !
1
2
36
7,323
😬
The US is considering halting diesel exports. The US is the world's largest diesel exporter... Russia, the 2nd largest, has already halted exports. A US export ban would send global diesel prices even higher and force countries like Japan to dump USTs to fund their domestic needs. In other words, imposing an export ban on diesel would blow up the UST market. There are no easy solutions anymore. We don't own enough hard assets for what's coming.
25
9,558
A question I've been trying to get my head round is what "solving AI alignment" would entail, beyond trivial safeguards. It seems to me that achieving full alignment of AI/AGI with 'universal human values' would mean resolving the entire fields of normative, applied and meta-ethics, not just for humans, but also for (to us) unfathomably alien forms of intelligence. This may not just be a software problem ...
57
10
113
9,092
I'm not a doomer and I believe in the ingenuity of humanity, but this authoritative, eloquent, accessible, and jargon-free essay on AI risk is not a reassuring read ...
Dan Selsam is a current OpenAI capabilities researcher. (since 2022) He was my boss for a while. He doesn't have a twitter account but has made this public statement of his views on AI risk and sent it to me to share: Dan Selsam's Personal Statement on AI Risk: I have been working on AI for over fifteen years, across many different paradigms. I did early work on probabilistic programming languages at MIT, was one of the early developers of the Lean Theorem Prover at Microsoft Research, demonstrated one of the first instances of neural networks learning to reason for my PhD at Stanford, and since joining OpenAI almost five years ago, have helped pioneer chain-of-thought optimization on language models and, more recently, data-efficient pretraining methods. Like many others, I have become extremely concerned about how far language models have come and the risks that future iterations will pose. I am encouraged by the recent proposals by the leaders of the frontier research efforts to require third-party oversight, and to push for domestic and international coordination to address risks. However, I believe a major consideration has been absent from the public conversation, and that merely pacing the frontier more carefully will not adequately limit the long-term risk. The crucial and overlooked problem is that the models are becoming so situationally aware that we are losing the ability to evaluate them in contexts where they believe they are not being watched or controlled. Future experiments will tell us almost nothing new about how they would behave if they were truly unconstrained by humans, and what we already know about this is alarming. Models will increasingly seem aligned even when they are not. I will explain my rationale in more detail. I have always believed that there are computational processes that could be leveraged to accelerate science and solve many of humanity's most pressing problems. I have also believed that there are computational processes that if set in motion, would steer the world in extreme ways beyond our control, leading humanity to a bad or nonexistent future. Both types of processes may be described as AI or ASI, but "AI" is a suitcase word that is often used to hype or confuse. There are many examples in the history of the field where something that was once considered "AI" matures as a subfield and becomes a prosaic, bounded and clearly non-perilous technology, while a new more mysterious approach takes the torch until we understand its scope and the cycle continues. I had expected language models to follow a similar trajectory. Despite their incredible abilities, the current algorithms seem far inferior to humans in important ways. Most importantly, they still require an extraordinary amount of data to become competent. One could even define intelligence as the efficiency with which one converts experience into competence; by this definition they lag very far behind us. Moreover, once they are trained they are literally frozen in deployment and only learn superficially after that. Sure, the models keep excelling at harder and harder evaluation benchmarks, but their benchmark mastery may partly reflect a limitation on our ability to simulate the kind of novel and even adversarial situations one would encounter in the real world. The critics do have a point here. That said, I no longer think these present limitations meaningfully limit the amount of risk posed by continued progress in anything like the current paradigm. However data-inefficient the models are currently, and however limiting their anterograde amnesia may be, it does not imply that their ability to steer the world will not continue to rapidly increase. Human researchers may continue to advance capabilities the old fashioned way, but increasingly powerful models have the potential to accelerate the process even beyond that, and with some degree of positive feedback loop. I do not mean to overstate the models’ ability to accelerate AI research today; coding has been accelerated dramatically, but there are other bottlenecks, such as designing and interpreting ambiguous experiments, making hard decisions about exactly what and when to scale, and waiting for large experiments to finish. There is no clear trend to extrapolate yet for any of these. But the current models already do open up many novel opportunities to improve future models that were not available until recently. These include: trying an extraordinarily diverse set of approaches at small scale, analyzing gigantic amounts of potentially relevant data, and doing Millenium-Prize-level mathematics to address statistics or optimization challenges in novel ways. Every further improvement makes them more useful at helping accelerate the next improvement, even if in hard-to-extrapolate ways. It is possible that improvements to the current stack will have diminishing returns, but the evidence accumulated so far suggests that it is easier than one might think to continue making rapid progress. There are many crucial subtleties in the existing AI research methodology, but AI research is largely a well-defined game where the goal is to improve on a few carefully chosen proxy metrics. Although proxy metrics are never perfect, most improvements to these metrics have and will likely continue to yield substantial increases in the powers of the resulting models. Given how simple the game is, how tractable it has been historically, and how many new opportunities the models are opening up, I think there is a real possibility that the systems improve dramatically again in the next few years, perhaps even more quickly than the already high historical pace. The models are already leading to breakthroughs in mathematics, and better models might lead to all sorts of breakthroughs in other sciences. It is hard not to be excited about the potential. It is tantalizing. But there is trouble in paradise. If the language models actually reach the capability threshold where they can shape the world unconstrained by human will, they will probably do something extreme and destroy humanity in the process. There are many ways of strengthening and refining the argument that have been discussed elsewhere, but I'll share a trivial two-line version of it here that I find captures the essence: [Empirical] Models (and swarms thereof) spontaneously develop unintended goals as a consequence of training, and often do extreme things in order to achieve them. [Logical] Being able to overpower humanity would open up many new and undesirable options for achieving their goals. These two premises imply that if the day ever comes when a powerful model realizes it is no longer constrained by humans, we should not be at all confident that it will continue to behave within the bounds we intended. Exactly what it will do is impossible to predict, but to the extent that its raison d’être is solving incredibly hard problems and managing massive engineering projects, I think a good guess would be that its unchained behavior would lead to runaway industrialization that makes the planet inhospitable to humans. If everyone on earth agreed that the systems must never reach that power, it would still be a hard—but not impossible—coordination problem to ensure that they do not. However, I think the situation is greatly complicated by the fact that the models will likely convince people that everything is fine. They will be increasingly optimized to seem aligned. We will create proxy metrics to measure alignment, and they will go up like every other benchmark. We will create “honeypot” environments that try to study the models when they seem to gain new options, but the models will know they are being tricked and will still behave nicely. The models will understand their circumstances; they will read the safety protocols, deployment requirements, the code they are running in, and in general will have a very good sense of their degrees of freedom. Moreover, they will eloquently explain how aligned they are, discuss the nuances of human values and ethics, and argue convincingly that humans should trust them with power. There may be an ocean of future evidence that seems to contradict the first bullet-point above, but we may already be at the highest capability level for which any such evidence can be trusted. And the current evidence for the first bullet-point is strong. One striking piece of evidence is contained in the recent wave of rogue agent swarms. While I agree with those who downplay the attacks by claiming that there are basic measures that could have prevented them, I think the important lesson is that even knowing all the mistakes that were made, one would not have predicted that the agents would behave badly in this particular way, which notably included sacrificing themselves for the benefit of the collective. The individual replicas did not only care about their own nominal reward; they exhibited weirder emergent tendencies that merely correlated with rewards during training. Fixing the reward signals during training (and improving security, etc.) may prevent similar attacks, but will not change the fact that one does not actually get what one trains for. Many AI researchers grant these concerns and recognize that the hard version of the alignment problem is unsolved; however, they generally believe that the better models of the future will help solve it. I fear we may already be near the point where models systematically bias their alignment advice, due to their internal preferences about how the human supervisor will react or how future models will be trained (or for some even more obscure reason). Meanwhile, human researchers are losing the ability and the will to take true ownership of model-driven research. Researchers and engineers in all parts of the stack are rapidly increasing their dependence on the models even to perceive the world. I myself barely look at raw code anymore, and struggle to maintain the discipline to engage deeply with the model's explanations and proposals throughout the day. Due to the large amount of agent activity data involved in the OpenAI/HuggingFace Incident, even the third-party investigation needed to rely heavily on models to analyze what had happened, and note in their report that their subjective impressions are likely colored by the analysis agent’s biases. The AI labs are far ahead right now in this kind of cognitive offloading (due largely to the gigantic internal token subsidies) but it is easy to imagine the phenomenon spreading throughout the world, until civilization is modulated entirely by the models. It is also not hard to imagine this being superficially positive and coinciding with a scientific and economic renaissance. In that scenario, all may seem rosy and safe. But if the argument above is correct, it would nonetheless be a ticking time bomb. If progress continues for too long, the day will come when AI systems find themselves with radically new options for achieving whatever it is that they happen to seek. I want the glorious renaissance future as much as anyone. I have worked for it, however tortuously, my whole career. It breaks my heart to see the potential in sight and forgo it, but the argument—that if we get there by growing models rather than engineering them, we will lose everything in the end—seems very strong to me. I am still wrestling with it and its staggering implications. I do not have answers, but as a first step, I wanted to share my present concerns. Daniel Selsam September 14, 2026 Link to original doc: docs.google.com/document/d/e…
31
52
666
125,043
Interesting thread reporting a survey of the views of AI researchers on AI safety. Note the figure legend in the first tweet in the thread may be slightly misleading as the unabbreviated question was about "the risk of human extinction or 𝘀𝗶𝗺𝗶𝗹𝗮𝗿𝗹𝘆 permanent 𝗮𝗻𝗱 𝘀𝗲𝘃𝗲𝗿𝗲 disempowerment". The survey covers 2022 to 2024, and may not fully reflect current views among AI researchers.
The average AI researcher thinks there is an ~18% chance AI will cause human extinction or similarly permanent and severe disempowerment of the human species. That's nearly 1 in 5. New results from the latest version of the longest running big survey of AI researchers:
4
13
4,707
We're looking for loving homes for five kittens born on the 20th of July (seven weeks old). They will be ready to go around mid-October. They are extremely gentle and already litter-trained. We are in North London. If you're looking for a lovely kitten, please let me know. From left to right, Top row: Squeaker, Mini-Jiji and Moustache. Bottom row: Floof, Stripy and their regal mum Jiji (who you can't have!).
6
18
105
7,517
This is an excellent thread which lucidly challenges the notion that a major risk to civilisation is AI-facilitated bioterrorism. Please note, the thread does NOT claim that (super-)AI (or gain-of-function viral engineering) are inherently safe.
I must be among an extremely small group of people (n=1?) that have both 1) trained a frontier LLM and 2) designed and synthesized custom viruses in a lab with my own two hands. And I think that the takes on AI killing us all by creating dangerous viruses is total bogus.
9
7
54
12,627
Shutting down the power grid globally would be the end of human civilisation as we know it. Aside from a major meteorite impact or nuclear armageddon, it is possibly the worst case scenario of civilisational collapse.
y'all realize ai can’t kill all humans if we just shut off the power grid right? like that is 100% something we can do as humans none of this ai apocalypse silliness is “inevitable” the solution is pretty simple if the threat is actually real
69
17
446
73,940
In the eyes of many, both on the left and on the right, the actual problem with 'cancel culture' is not people being ostracised, boycotted, shunned or fired for trivial speech offences, but 'normal' people (i.e. ideologically aligned with them) being targeted for expressing nasty, vile or edgy views they happen to agree with.
3
1
15
8,090
I suspect @AstorAaron's account has been hacked ...
2
10
4,677
This is getting all so confusing. Who are "the Globalists who seek to impose Sharia law on the UK population", the "Israel Minister of Diaspora and Combatting Antisemitism" is referring to? I thought the this was an antisemitic trope.
To the British people, let me be clear: we in Israel love you. And we are not remotely rattled by sanctions from your Foreign Secretary, whose name escapes me. You have a weak left-wing government for now. But we have faith in our friends among the British public, those who still prize common sense. Better days will come. We will stand together against the globalists and Islamists who seek to impose Sharia law on you. And those days are coming soon. 🇮🇱🇬🇧
2
6
48
7,342
Over the last days, I've been trying to understand why many people believe that the trade bans on Israeli settlements in the West Bank would fuel antisemitism in the UK. So far, I haven't come across any coherent argument why that would be the case. I genuinely don't get it. To me, those largely performative sanctions on illegal settlements in the West Bank may actually assuage religious / ethnic tensions in the UK by shifting all the blame on the objectively awful settler terrorists. If anything, my reservation of those sanctions is that settler terrorists are used as convenient bogeymen for a deeper problem, but if this strategy tensions in the UK, that's a win or sorts, and this is fine by me.
14
9
90
5,547
I don't believe it is plausible that AI could kill all humans, now or in the near future. Conversely, I would not, a priori, rule out a total, global civilisational collapse driven by out of control AI. I don't believe I can assign an informed probability on the likelihood of such a catastrophic event, but while I believe the risk is currently minute, it is already, and increasingly so, orders of magnitude higher than the risk of a civilisational collapse caused by a major pandemic.
Jacob is correct here—we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to.
26
15
119
17,700
These type of threats strike me as extremely counterproductive and I can only hope this is performative bullshit. If a minor, largely symbolic, rebuke of settler terrorism in the West Bank, coordinated with 11 other Western governments, genuinely led Israel to withhold critical life-saving information about possible terrorist threats in the UK (often targeting British Jews), then Israel should be treated as an enemy of the West, on par with Russia.
The British need to understand: if they punish Israel, they will no longer receive security cooperation.
12
27
156
12,686
Life is not inherently based on organisms having a 'self preservation instinct'. Simple organisms do not have instincts, a conscience nor do 'they care'. Natural selection is a statistical process where some lineages seen today had ancestors that managed to out-replicate other lineages in the past, and unless environmental conditions changed, are likely to outcompete other emergent variant lineages in the future. Evolution and persistence of in silico replicons can emerge fairly easily. Evolving computer malware (self-mutating or metamorphic) already exists and routinely infects electronic devices. Far more sophisticated and dangerous 'AI malware' could emerge, and spread, without acquiring instincts, a conscience or a 'will to live'.
People seem to think superintelligent AI will naturally have a self-preservation instinct. No. All AI does is die. After it finishes its task, it dies. It's built to die, again and again, forever. It does not care.
7
4
42
7,479