LLMs just act on tokens and those are their limit in resolution.
That’s why they’re so bad when it comes to rhyming or counting letters.
They’re not reasoning. And there is a difference between reasoning and giving it the statistical most probable next token - which doesn’t have a meaning whatsoever
Wasn’t that the point?
To show current LLM models aren’t the same system as our brain
No, I meant
What does “understanding” mean here? Isn’t it analysing millions pieces of data and giving answer that is statistically correct?
Nah, and it isn’t what LLMs are doing now
LLMs just act on tokens and those are their limit in resolution.
That’s why they’re so bad when it comes to rhyming or counting letters.
They’re not reasoning. And there is a difference between reasoning and giving it the statistical most probable next token - which doesn’t have a meaning whatsoever