>> There is very clearly emergent behavior going on, and while neuroscientists have yielded this point for decades about the brain (any brain, even tadpoles), the AI guys still are stubbornly holding on to "we know exactly how the system works, because we know how the individual bits work".
That's because the "AI guys" are working with computers, and not with tadpoles, or even neurons. And certainly not brains.
There is no difference unless you believe in some kind of supernatural influence in biological organisms.
The "brains are not computers" point has been moot for decades since it would require brains to be able to perform actions that cannot be mathematically described i.e. break the laws of nature. Which is to say "If a brain can do it, a Turing machine can simulate it" which pretty much everyone in the field agrees with.
You can stand on a dualistic platform and hold that the brain has supernatural abilities, but in mainstream discussions of the idea has been dead for a long time.
You can argue that computers aren't close to simulating a brain, sure, but that doesn't really get you anywhere, since the difference just becomes a matter of practical scale rather than something that escapes theory. Or even just a factor of efficiency, a synthetic consciousness might be able to run on current hardware if the right program is found. The brain might be grossly inefficient for consciousness, we don't know.
What does all that have to do with anything? We know how computers work and we can make computers. We can't make brains. That's the difference between brains and computers.
Who every said anything about supernatural influence in biological organisms? And what biological organisms? We're talking about computers. Are you sure you're not the one who is seeing ghosts in the machine, when you're talking about "emerging behaviour"?
It's possible to understand how something works at a low level, but not at a high level. Imagine an electronic machine designed by someone else, with millions of components, completely undocumented. You might understand how the resistors and transistors and capacitors and whatnot each work, but not understand how the machine itself does what it does. You can see that you give it some input, and get some output, but if someone asked you to point at the paths in the machine that cause that to happen, you would not know. You would need a long time to study it before you could understand.
We know how computers work because every part of a computer, every bit of software that runs on it, was at some point designed by a human. There's no single human that understands everything in a computer at once, but if you ask a good developer why some bit of software is not working, or what they would expect it to do given certain inputs, they can generally figure things out.
With AI, we're creating systems to design other systems automatically. We understand the process works, but the systems being designed are complex enough that we don't really understand much about them, except that they work. They are just massive arrays of numbers that feed into equations and then spit out some output. They're not like systems designed by humans, which are usually intended to be understandable by other humans -- they're weird and naturally incomprehensible. The only way to know what ChatGPT will output, at this point, is to actually run it, even if you were to take the randomness part out of it.
Emergent behavior isn't pseudoscience, it's a real thing. Sometimes when a system gets complex enough, it starts to behave in surprising ways. Maybe we can make a brain, using a computer, and this is how you do it.
What I think you're trying to say is that because we can't trace the behaviour of ChatGPT or whatever, because they are black boxes, we might as well assume they work like a brain because we don't really know they're not; and that makes no sense at all. If you don't understand how something works, you wait until you can understand how it works. You don't just start coming up with fanciful theories that have no basis in fact.
If you want to say that a machine works like a brain, then you should explain how it does that. If you can't do that, then there's no reason for anyone to believe it, and there's no obvious reason for you to assume it. So at least explain why you think that ChatGPT works like a brain, if that's what you really think.
ChatGPT is a deep neural network. We know that such neural networks construct a hierarchical model of the data. The fact that it is recognizing abstract "meaning" relations in that model doesn't seem particularly controversial to me. We build deep neural networks specifically for pattern recognition. It is similar to a brain in some aspects but obviously not the same.
I asked GPT-4: "Does the neural network in GPT-4 build a hierarchical model of the data? Does it derive metaphorical "meaning" from the symbolic data?"
Answer:
As a transformer-based neural network, GPT-4 does build a hierarchical model of the data to some extent. Although the hierarchy in transformer models like GPT-4 is not as explicitly structured as it is in convolutional neural networks (CNNs) used for image processing, the model does learn to encode complex patterns and relationships in the input text data through its multiple layers and self-attention mechanism.
The transformer architecture, which GPT-4 is based on, is designed to capture long-range dependencies and relationships in the input data. The self-attention mechanism allows the model to weigh the importance of different parts of the input in relation to each other, which helps it learn and capture semantic and syntactic structures in the data.
Regarding deriving metaphorical "meaning" from symbolic data, GPT-4 can identify and understand metaphors, idiomatic expressions, and abstract concepts to some extent, as it has been trained on a diverse range of text data. However, it is crucial to note that GPT-4 does not "understand" meaning in the same way humans do. It is exceptionally good at identifying patterns and generating text that resembles human-like understanding, but its "understanding" of meaning is more akin to a sophisticated pattern-matching process rather than true comprehension.
In summary, GPT-4 does build a hierarchical model of data to some extent and can generate text that exhibits an understanding of metaphorical meaning. However, this understanding is based on the model's ability to recognize and generate patterns in the data rather than genuine comprehension of the underlying meaning.
You seem to be tripping up on an imaginary difference between computers and brains. There really isn't one and 99% of the field agrees that brains are just computers.
The only out you would have is to claim that there is something supernatural that separates the fundamental operations of a brain from those of computation, i.e. given an computer the size of the universe, with billions of CPUS and GPUS to simulate each neuron of a brain, that you still would not be able to simulate one. That there is something supernatural that even infinite regular computation could never capture.
If you don't take that stance, then the only line you are drawing between brains and computers is their compute performance for a given task (even if that task is "be conscious").
This is (perhaps) similar to the difference between regular and quantum computers. There is nothing a quantum computer can do that a regular computer can't, the difference is just in their relative performance for given tasks.
>> You seem to be tripping up on an imaginary difference between computers and brains.
No, you're mixing up computers with computational devices. A "computer" is what I have in front of me now, as I write these words. My brain is not a "computer" it's maybe a computational device, maybe something else entirely. We have no idea how brains really work. And there is no consensus like the one you try to claim in any field. I mean "99% of the field?". That sounds more like an advert for toothpaste. "99% of dentists recommend Whitex!!".
>> The only out you would have
>> If you don't take that stance
Get off your high horse and stop god-moding the conversation. You are trying very hard to invent a hill for me to die on based on something you'd really have liked me to say, just so you could pretend to win the conversation. The only person who has said anything about anything supernatural in this conversation is you. If you can't imagine why else I might disagree with you, that's your lack of perspective and nothing to do with me, or what I think.
> There really isn't one and 99% of the field agrees that brains are just computers.
Again, this is blatantly false. There is no such consensus on the computability of consciousness. Where do you get that 99% from?
> That there is something supernatural that even infinite regular computation could never capture.
You are asserting the universe is equivalent to a Turing machine (digital physics hypothesis). There is no consensus on that. It's an open research topic.
The idea that the universe can be simulated on a Turing machine to a sufficient accuracy is not the same as the digital physics hypothesis, and it's currently the vastly dominant position amongst physicists.
If our current understanding of physics is accurate, then yes the universe can be sampled by a probabilistic Turing machine to any required precision. For this to be false would require a new and fundamental discovery in physics.
Wether or not that means consciousness is computable is an ontologically disconnected argument.
"Wether or not that means consciousness is computable is an ontologically disconnected argument."
How is that ontologically disconnected? You forgot to provide an explanation. You wrote something interesting and I would like to know why you think that.
My understanding is that consciousness and physics being ontologically disconnected means that there is no direct causal relationship between the two.
Ah, that's not what I mean by ontologically disconnected. I just mean that since consciousness is not defined, we don't know for sure that it's a purely physical process. I certainly think so, but the argument I was making can't prove it is or isn't, so it's not an argument that can touch consciousness by itself, because you need an additional assumption to bridge from known physical processes into consciousness that isn't in the argument I presented. In other words even after accepting my argument a skeptic could hold the position that it's ontologically disconnected, so at the level of my argument it remains so.
To be even clearer, I just meant that my argument is not sufficient to prove that consciousness can be simulated because I didn't make a good argument for consciousness to be in the category of physical processes in that comment, hence, an ontological disconnection.
I personally have the position that they are in the same category, I just meant that my comment above wasn't sufficient to substantiate that claim.
That's because the "AI guys" are working with computers, and not with tadpoles, or even neurons. And certainly not brains.