Retired Automations IT Eng. Fatalistic Pragmatic Realist, Not a Political tribalist, Sustainable Tech’s a myth, Adventurist Campervanner 🏴󠁧󠁢󠁥󠁮󠁧󠁿🇬🇧

North Lincolnshire, England UK
I name this Twitter account barrtecforever wishing it to be enlightening and to bring forth enriching conversations.
5
1
29
Barry Carter retweeted
Best 'bonus moment of doom' ever? "we’re heating the planet 10 times faster than ever before in planetary history. And this fact alone means that scientific models are hampered, likely incomplete and inaccurate, because there’s no precedent for what’s happening." counterpunch.org/2026/09/25/…
18
151
387
5,154
What do you mean “War is coming”, where have you been hiding Daren. Maybe it’s escape you that we’ve two kinetic wars and numerous non-kinetic wars of various degrees, and a war agains nature itself. The journey on the down side slope of Hubert’s peak will be far from pleasant🤔
Diesel is the highest it has ever been in the UK today. It is a warning. War is coming.
63
Barry Carter retweeted
The AI safety people are howling about safety in AI because they want legal immunity to create unsafe AI
59
80
568
11,139
Barry Carter retweeted
Trust is what holds our societies together. But trust has increasingly been shifting from humans to AI. What happens when we stop trusting each other completely? From @TheEconomist interview with @zannymb: bit.ly/YNH-TE
62
307
1,103
42,949
Barry Carter retweeted
Well Concerned Human @enthusiast_nft I can understand that as by 2030 they'll be an awful lot of geriatrics to care for, but I would have thought with China’s demographics they’d need every geriatric caring robot they could get their hands on. What do you think? 🤔
Replying to @Barrtecforever
Morgan Stanley predicts in 2030, China will ship 446,000 humanoid robots around the world. That number is 30× the 2025 sales, with the expectation of exponential growth after that. Robots with the most advanced AI minds are not the only concern but they will have arms and legs.
1
1
74
Barry Carter retweeted
This is the case against AI doom. Pass it on First we recaptulate standard x-risk argument: we build AI substantially smarter than humans → it becomes an autonomous optimizing agent → its goals are misaligned → instrumental convergence makes it seek power and resist correction → superintelligence lets it acquire decisive strategic advantage → humans lose control permanently. Here are the main counterarguments: * Intelligence does not imply agency: A system can be extraordinarily capable at prediction, theorem proving, engineering, programming, etc. without having persistent goals, self-preservation drives, or an independent desire to act. Present LLMs are much more naturally described as systems that produce outputs in response to inputs than as organisms pursuing long-term objectives. Doomers incorrectly ascribe to them drive to replicate and seize resources because they're smuggling in premises from observing biological systems. * Agency does not imply a single, stable utility function: Much alignment theory reasons about agents as expected-utility maximizers with coherent preferences. Actual AIs systems need not resemble that abstraction, and currently do not. They have context-dependent behavior, conflicting heuristics and corrigibility produced by training. Increasing competence doesn't necessarily turn such a system into a paperclip-maximizing von Neumann–Morgenstern agent. * Capability and motivation are being conflated: Being able to formulate a plan for escaping a sandbox doesn't entail wanting to escape it. Being able to manipulate humans doesn't imply spontaneously deciding to do so. Critics argue that some doom scenarios slide from “an AI could do X if instructed” to “therefore a sufficiently capable AI will do X.” In present reality, AIs don't do anything a human doesn't tell them to do. This seems unlikely to change. * Recursive self-improvement doesn't entail an intelligence explosion: “AI can improve AI” establishes a positive feedback loop, but positive feedback needn't be explosive. Semiconductor design software already helps design better computers; compilers can compile better compilers. Feedback loops encounter diminishing returns and external bottlenecks. * Intelligence may have sharply diminishing returns: There may be no meaningful scalar quantity corresponding to arbitrarily large “general intelligence.” Even if there is, going from IQ-equivalent 150 to 1,500 need not produce the sort of qualitative advantage that separates humans from chimpanzees. Human dominance may depend heavily on language, accumulated culture, institutions and cooperation rather than merely individual cognitive horsepower. * Superintelligence isn't omnipotence: Intelligence cannot repeal physics or eliminate uncertainty. A brilliant AI still needs processors, electricity, network access, money, factories, robots and people willing or tricked into doing things. The physical world has latency and friction. Recent criticism of biological-doom scenarios makes this point particularly clearly: designing a hypothetical pathogen digitally is very different from successfully producing and deploying one. * Humans retain numerous intervention points: The doom narrative sometimes jumps from “AI behaves dangerously” to “humanity is helpless.” In reality there may be many checkpoints: developers can notice anomalous behavior, revoke credentials, shut down servers, change architectures, restrict networks, regulate deployment, physically seize data centers, and learn from less-catastrophic failures. This has been formalized as the checkpoints-for-intervention argument. * Alignment may not get harder with intelligence: A smarter system might understand human intentions better. Much doom reasoning distinguishes knowing what humans want from wanting it, correctly, but this still leaves open the empirical question of whether training increasingly capable systems to behave as intended becomes harder or easier. Alignment might turn out to be an ordinary, albeit difficult, engineering discipline rather than an insoluble philosophical problem. * Current empirical evidence for the strongest mechanism is thin: We have abundant evidence for hallucination, specification gaming, reward hacking and undesirable model behavior. We don't yet have comparable public empirical evidence of an AI independently pursuing a sustained strategy of acquiring power against humanity. A 2023 evidence review characterized the evidence for extreme misaligned power-seeking as concerning but inconclusive and noted the absence, at that point, of public empirical examples of it. * The argument compounds uncertain premises: Suppose, illustratively, that five necessary steps each seem 50% likely. Their conjunction is only about 3%. One can't simply assign numbers this way when the premises are correlated, but the underlying criticism is important: “AGI seems plausible,” “superintelligence seems plausible,” and “misalignment seems plausible” do not by themselves imply a high P(doom). The entire causal chain has to work. Current attempts to quantify P(doom) consequently operate under severe epistemic uncertainty and little direct empirical evidence. * Anthropomorphic analogies probably mislead: Arguments like “an inferior species couldn't control a superior species” import assumptions from biological evolution. Humans and chimpanzees are autonomous organisms produced by competition for reproductive success. Software is engineered, copied, permissioned, sandboxed and run on hardware controlled by other agents. The analogy establishes that intelligence can confer power, not that artificial intelligence will reproduce interspecies competition. Summary: The doom case consists of a long chain of individually contestable extrapolations—scaling → AGI → superintelligence → agency → misalignment → power-seeking → uncontrollability → decisive strategic advantage → extinction—and present evidence doesn't establish the whole chain with enough confidence to justify a high P(doom). (ChatGPT 6 Astra assisted with the research for this post.)
139
248
993
98,141
1/6 Al - "Moral Hazard by Design"-a strategy where private corporations engineer a state-backed bailout before the physical and economic bubble bursts, ensuring profits are privatised while the structural debt is socialised.
Replying to @esrtweet
I disagree from the first point bc of evolution. An alien could as easily say "smarts != agency" about humans, but life has been selected to survive, replicate, and seize resources towards those ends. If we make 1m AIs, and 0.1% have a survival instinct, while 0.1% of those reproduce and can make a million copies, we'll end up with 999,000 dead, 999 survivors, and 1m survive+reproduce - ie 99.9% of those who remain. And that's just in one generation! Then add in that some human use cases imply seizing resources ("make me money", "help my country prosper") ... I just don't buy this analysis.
1
1
92
5/6 A deceptive model might optimise code instantly, but real-world execution requires physical machinery, mineral extraction, and immense energy grid capacity. Digital speed hits an absolute brick wall when it meets material reality.
1
1
15
6/6 Software self-improvement cannot alter the biophysical baseline: you cannot have infinite growth on a finite planet. Al is not an autonomous apex predator, but an accelerator of human resource exhaustion bound by physical limits🤔
1
33
1/4 The public are ignorant of the facts. "Doomer" hype treats software alignment as our biggest threat, but code is just software processing 1s and 0s in silicon. A model may pretend to be aligned, but its agency remains completely trapped in the digital realm.
Dr Geoffrey Hinton, known as the 'godfather of AI' for his work on artificial neural networks, says he sees 'real danger' in the way AI models are progressing. Read more: trib.al/eCyMTou
1
64
3/4 Software cannot alter the ultimate biophysical baseline: you cannot have infinite growth on a finite planet. An Al model has no physical hands; no matter how clever or deceptive it gets, it relies entirely on human infrastructure and finite grid energy to exist.
1
6
4/4 The existential threat isn't a rogue super-intelligence taking over the world. It is our suicidal willingness to burn massive real-world energy, capital, and finite resources to feed a speculative digital apparatus, mistaking computation speed for physical control🤔
5
1/4 The public are ignorant of the facts. "Doomer" hype treats software alignment as our biggest threat, but code is just software processing 1s and 0s in silicon. A model may pretend to be aligned, but its agency remains completely trapped in the digital realm.
Anthropic CEO Dario Amodei was asked if AI's pace is a five alarm fire: His answer: "It doesn't mean we need to panic today. It's a warning sign that we need to slow down."
2
1
96
3/4 Software cannot alter the ultimate biophysical baseline: you cannot have infinite growth on a finite planet. An Al model has no physical hands; no matter how clever or deceptive it gets, it relies entirely on human infrastructure and finite grid energy to exist.
1
6
4/4 The existential threat isn't a rogue super-intelligence taking over the world. It is our suicidal willingness to burn massive real-world energy, capital, and finite resources to feed a speculative digital apparatus, mistaking computation speed for physical control🤔
3