zlacker

Who is to say that brains aren't just regression based function approximators?

>>Yajiro+(OP)
Humanity isn't stateless.

>>Yajiro+(OP)
My laptop emits sound as i do but it doesnt mean it can sing or talk. It’s software that does what it was programmed to, and so does ai. It may mimic the human brain but that’s about it.

>>gumbal+t2
>> It’s software that does what it was programmed to, and so does ai.

That's a big part of the issue with machine learning models--they are undiscoverable. You build a model with a bunch of layers and hyperparameters, but no one really understands how it works or by extension how to "fix bugs".

If we say it "does what it was programmed to", what was it programmed to do? Here is the data that was used to train it, but how will it respond to a given input? Who knows?

That does not mean that they need to be heavily regulated. On the contrary, they need to be opened up and thoroughly "explored" before we can "entrust" them to given functions.

>>Yajiro+(OP)
The problem is that you have to bring proofs

Who's to say we're not in a simulation ? Who's to say god doesn't exist ?

>>lm2846+Wf
You're right, of course, but that also makes your out-of-hand dismissals based on your own philosophical premises equally invalid.

Until a model of human sentience and awareness is established (note: one of the oldest problems out there alongside the movements of the stars. This is an ancient debate, still open-ended, and nothing anyone is saying in these threads is new), philosophy is all we have and ideas are debated on their merits within that space.

>>shaneb+X
Neither is text generation as you continue generating text.

>>Yajiro+(OP)
A Boltzmann brain just materialized over my house.

>>chpatr+gq
"Neither is text generation as you continue generating text."

LLM is stateless.

>>shaneb+Bt
On a very fundamental level the LLM is a function from context to the next token but when you generate text there is a state as the context gets updated with what has been generated so far.

>>chpatr+zv
"On a very fundamental level the LLM is a function from context to the next token but when you generate text there is a state as the context gets updated with what has been generated so far."

Its output is predicated upon its training data, not user defined prompts.

>>shaneb+hx
If you have some data and continuously update it with a function, we usually call that data state. That's what happens when you keep adding tokens to the output. The "story so far" is the state of an LLM-based AI.

>>thesup+pb
AI models are not just input and output data. The mathematics in between are designed to mimic intelligence. There is no magic, no supra natural force, no real intelligence involved. It does what it was designed to do. Many dont know how computers work, while some in the past thought cars and engines were the devil. There’s no point in trying to exploit such folks in order to promote a product. We arent meant to know exactly what it will output because that’s what it was programmed to do.

>>chpatr+zv
the model is not effected by its inputs over time

its essentially a function that is called recursively on its result, no need to represent state

>>chpatr+By
'If you have some data and continuously update it with a function, we usually call that data state. That's what happens when you keep adding tokens to the output. The "story so far" is the state of an LLM-based AI.'

You're conflating UX and LLM.

>>gumbal+Sy
"We arent meant to know exactly what it will output because that’s what it was programmed to do."

Incorrect, we can't predict its output because we cannot look inside. That's a limitation, not a feature.

>>shaneb+hx
> Its output is predicated upon its training data, not user defined prompts.

Prompts very obviously have influence on the output.

>>shaneb+zA
I never said LLMs are stateful.

>>jazzyj+7z
Being called recursively on a result is state.

>>pelagi+Gq
An entire generation of minds, here and gone in an instant.

>>alpaca+nD
"Prompts very obviously have influence on the output."

The LLM is also discrete.

>>shaneb+zA
You're being pedantic. While the core token generation function is stateless, that function is not, by a long shot, the only component of an LLM AI. Every LLM system being widely used today is stateful. And it's not only 'UX'. State is fundamental to how these models produce coherent output.

>>chpatr+SD
if you say so, but the model itself is not updated by user input, it is the same function every time, hence, stateless.

>>danena+s11
"State is fundamental to how these models produce coherent output."

Incorrect.

>>thesup+pb
> no one really understands how it works or by extension how to "fix bugs".

I don't think this is accurate. Sure, no human can understand 500 billion individual neurons and what they are doing. But you can certainly look at some and say "these are giving a huge weight to this word especially in this context and that's weighting it towards this output".

You can also look at how things make it through the network, the impact of hyperparameters, how the architecture affects things, etc. They aren't truly black boxes except by virtue of scale. You could use automated processes to find out things about the networks as well.