The embedding layer in an llm deals with much more than the meaning. It has to c... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

danielmarkbruce 42 days ago | parent | context | favorite | on: Ask HN: Any insider takes on Yann LeCun's push aga...

The embedding layer in an llm deals with much more than the meaning. It has to capture syntax, grammar, morphology, style and sentiment cues, phonetic and orthographic relationships and 500 other things that humans can't even reason about but exist in words combinations.

heyjamesknight 38 days ago [–]

I'll give you that. I was including those in "semantic space," but the distinction is fair.

My original point still stands: the space you've described cannot capture a full image of human cognition.

Join us for AI Startup School this June 16-17 in San Francisco!
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact