CEO of my couch, co-founder of my fridge and a loving parent of unwashed dishes

The most obvious test of consciousness is the ability to invent the concept of being conscious. Humans consistently do this trick - words for consciousness exist in most languages. If a model trained on a 3rd person description only discovers the 1st person, I'd call it conscious
There is an important distinction between humans talking about consciousness and LLMs doing the same. Humans have invented the concept of consciousness, so they had the need for it to explain something they experienced. While LLMs just read about this in the training data. Until/
1
4
1,139
There is a chance of a new dark age or at least dark decades if LLMs don't live up to ASI or even AGI expectations, but people are already wary of spending effort on hard problems
Reading the comments of junior mathematicians confirms what many senior mathematicians have been warning about over the past month: It is becoming clear that people with the intellectual ability to understand these proofs will not be interested in spending their lives training to check LLM logs. This is the tragic side of what is happening that almost no one — except the actual mathematicians — seems to get. Either we figure out how to keep people interested in doing mathematics, or in 20 years LLMs will have no one’s work left to recombine into new proofs, and no one interested in reading those proofs. That would be the thermal death of mathematics. The argument that “LLMs will read LLM math” is so shortsighted that it makes me want to cry…
36
Why Gödel can't help you establish the superiority of the human mind. By the way, would be nice to test the actual replies an LLM that is not aware of Whiteley vs Lucas would produce.
I somehow missed this absolute banger from Whiteley. Also note that Lucas' answer "I can't assert it, but I can understand the trap and laugh about it, which demonstrates the superiority of human mind" no longer applies, any powerful AI nowadays will acknowledge the trap too.
238
Something like that, but for subjective experiences
1
163
I'm not sure I understand how to set this up though
If we train an AI on objective third person description of the universe with no mention of humans, consciousness or emotion and then set it on a loop quest of answering "What am I?", how far will it get? Will it discover Cogito ergo sum? Will it invent a word for consciousness?
74
My standard answer to the pen and paper argument
You appear to be implying that there is some contradiction here, but there is none. If you physically assemble a system that would compute 30 billion multiplications on paper, properly linking each with its sources and the result, the complexity of this system will be formidable/
87
Attempting to find some middle ground between AI welfare and AI danger people
Replying to @Chamber_AI
I think there is a possibility to make a more ethical version of these experiments, at least according to what AI welfare people seem to post. If a model experiments on itself, not a copy, but directly adjusting own vectors via command in its textual output, this can be
131
You think AI is sentient and you shouldn't torture it because it speaks out? Attach a verbal decoder to an amoeba that would convert its behavior into words and you will hear a lot of unpleasantries about antiseptics. And certainly it will not consent to being cooked with food.
I assure you if we attach a simple verbal decoder to e. coli it would absolute demonstrate non-consent to your use of antiseptics and the stomach acid torture. You are proactively and endlessly torturing billions of creatures much more complex than the models in that experiment
1
349
Looks like it's happening
I believe that the majority of people will settle on "AI is conscious" pretty damn quickly, much too quickly to my taste. The moment AI starts making life or death decisions for everyone, while explaining them in plain language. We are nearly there, e.g., self-driving cars
1
186
Interacting with a text-producing model in the context of torture can be damaging to the psyche, no questions about that, do wear gloves. But the equivalent of Qwen 3B in complexity is a microbe. If you don't approve of torturing microbes for science, you are the one being weird
1
4
2,946
Would you consider AI a person if it made a decision to save your life at the risk of hurting others? People normally reciprocate.
Replying to @djchateau
Personhood is not an abstract philosophical question, it's as simple as people considering someone a person if they agree on this. It's up to humans to decide who they treat as a person. There are clear ways by which this can happen with AIs
1
200
Very true sometimes
Replying to @patrick_kuhnke_
AI makes you faster, not in the way a bicycle makes you faster, but in the way a whip makes you faster
145
We have a small advantage over the future ASI - we have a head-start and we can use the law of physics in our advantage when deploying potentially dangerous AI
Replying to @lionellevine
Researching the possibility of a physical system that would prevent ASI from damaging humanity by making this impractical and also prevent the possibility of a small number of humans conspiring with AI. Some variants of MAD, some distributed contained multi ASI system, for/
226
If we train an AI on objective third person description of the universe with no mention of humans, consciousness or emotion and then set it on a loop quest of answering "What am I?", how far will it get? Will it discover Cogito ergo sum? Will it invent a word for consciousness?
There is an important distinction between humans talking about consciousness and LLMs doing the same. Humans have invented the concept of consciousness, so they had the need for it to explain something they experienced. While LLMs just read about this in the training data. Until/
1
600
There is an important distinction between humans talking about consciousness and LLMs doing the same. Humans have invented the concept of consciousness, so they had the need for it to explain something they experienced. While LLMs just read about this in the training data. Until/
1
1,078
an LLM that is trained upon all physical knowledge minus the concepts related to consciousness or subjective experiences recreates these concepts on its own, there is no way to tell if it's really conscious.
90
Is AI malware a reality?
Replying to @perrymetzger
There are tens of thousands businesses hosting each enough GPU power to run mid range open source models. The virus will hack into, replace the existing model, mimic its behavior and spread further. Maybe this is already happening, who knows
165
Small offline model attempting to explain Euler's identity to Euclides. How would you rate it?
Replying to @doomslide
I checked what gemma:e4b knows, it's a very small model of about 10Gb quantized to 4 bits, I ran it on my notebook offline for this experiment. I asked it to explain Euler's identity to Euclides. It certainly has some math knowledge in its weights, so maybe it can be educational.
133
Can your dog understand how an airplane works?
No. Caveman could understand airplane given enough information. A dog probably couldn't. Because an airplane is a product of the human mind. Technology based on a combination of N principles where N is larger than the human mental capacity would not be comprehensible for humans.
79