All the articles about LLMs passing different exams isn't helping. LLM can pass exam X etc..

Of course it can pass exams, so could a database storing the answers.

Ask it to try multiply two floating point numbers though and you often get the wrong answer.