zlacker

[return to "Three senior researchers have resigned from OpenAI"]
1. dschue+D3[view] [source] 2023-11-18 07:38:34
>>convex+(OP)
Are those the first cracks in the AI market bubble?
◧◩
2. huyter+X3[view] [source] 2023-11-18 07:43:26
>>dschue+D3
Is it a bubble if it’s useful and I use it dozens of time a day?
◧◩◪
3. mi3law+m4[view] [source] 2023-11-18 07:46:48
>>huyter+X3
It can be useful in certain contexts, most certainly as a code co-pilot, but that and yours/others' usage doesn't change the fundamental mismatch between the limits of this tech and what Sam and others have hyped it up to do.

We've already trained it on all the data there is, it's not going to get "smarter" and it'll always lack true subjective understanding, so the overhype has been real, indeed to bubble levels as per OP.

◧◩◪◨
4. tempes+T4[view] [source] 2023-11-18 07:51:08
>>mi3law+m4
> it's not going to get "smarter" and it'll always lack true subjective understanding

What is your basis for those claims? Especially the first one; I would think it's obvious that it will get smarter; the only questions are how much and how quickly. As far as subjective understanding, we're getting into the nature of consciousness territory, but if it can perform the same tasks, it doesn't really impact the value.

◧◩◪◨⬒
5. mi3law+Sc[view] [source] 2023-11-18 09:02:26
>>tempes+T4
My basis for these claims is from my research career, work described so far at aolabs.ai; still very much in progress, but form what I've learned I can respond to the 2 claims you're poking at--

1) we should agree on what we mean by smart or intelligent. That's really hard to do so let's narrow it down to "does not hallucinate" the way GPT does, or more high level has a subjective understanding of its own that another agent can reliably come to trust. I can tell you that AI/deep learning/LLM hallucination is a technically unsolvable problem, so it'll never get "smarter" in that way.

2) This connects to number 2. Humans and animals of course aren't infinitely "smart;" we fuck up and hallucinate in ways of our own, but that's just it, we have a grounded truth of our own, born of a body and emotional experience that grounds our rational experience, or the consciousness you talk about.

So my claim is really one claim, that AI cannot perform the same tasks or "true" intelligence level of a human in the sense of not hallucinating like GPT without having a subjective experience of its own.

There is no answer or understanding "out there;" it's all what we experience and come to understand.

This is my favorite topic. I have much more to share on it including working code, though at a level of an extremely simple organism (thinking we can skip to human level and even jump exponentially beyond that is what I'm calling out as BS).

◧◩◪◨⬒⬓
6. calf+6h[view] [source] 2023-11-18 09:38:42
>>mi3law+Sc
Then why can't the the grounded truth of ChatGPT be born of a body of silicon and emotional experience of zillions of lines of linguistic corpus?
◧◩◪◨⬒⬓⬔
7. mi3law+Nt[view] [source] 2023-11-18 11:25:38
>>calf+6h
Those zillions of lines are given to ChatGPT in the form of weights and biases through backprop during pre-training. The data does not map to any experience of ChatGPT itself, so it's performance involves associations between data, not associations between data and its own experience of that data.

Compare ChatGPT to a dog-- a dog's experience of an audible "sit" command maps to that particular dog's history of experience, manipulated through pain or pleasure (i.e. if you associate treat + "sit", you'll have a dog with its own grounded definition of sit). A human also learns words like "sit," and we always have our own understanding of those words, even if we can agree on them together too certain degrees in lines of linguistic corpora. In fact, the linguistic corpora is borne out of our experiences, our individual understandings, and that's a one way arrow, so something trained purely on that resultant data is always an abstraction level away from experience, and therefore from true grounded understanding or truth. Hence GPT (and all deep learning) unsolvable hallucination or grounding problems.

◧◩◪◨⬒⬓⬔⧯
8. calf+TA[view] [source] 2023-11-18 12:17:05
>>mi3law+Nt
But I'm not seeing an explicit reason why experience is needed for intelligence. You're repeating this point over and over again but not actually explaining why, you're just assuming that it's a kind of given.
[go to top]