> to accurately produce the next token you must have an understanding of the world you're talking about.
I don't think this is true. It seems to me that you could do this through sheer statistics, and have no understanding of the world you're talking about at all.
>It seems to me that you could do this through sheer statistics, and have no understanding of the world you're talking about at all.
I'm not sure that there is a difference. If there is, what would be an example of true understanding vs just statistics? All of intelligence is ultimately recognizing patterns and layers of patterns of patterns.
Sentience? Consciousness? Who knows. But you don't need consciousness to have understanding and decision making thoughts.