Listen to a video made by Karpathy about LLM, he explains why made up html tags ...

dotancohen · 2025-05-25T11:15:44 1748171744

I recall this even being in the Anthropic documentation.

dotancohen · 2025-05-25T11:18:28 1748171908

Here, found it:

  > Use XML tags to structure your prompts

  > There are no canonical “best” XML tags that Claude has been trained with in particular, although we recommend that your tag names make sense with the information they surround.

https://docs.anthropic.com/en/docs/build-with-claude/prompt-...

justsomehnguy · 2025-05-25T20:42:07 1748205727

My guess would be there is enough training materiel what a mere tagging sometging is enough to have a bigger SNR.

victor106 · 2025-05-25T04:56:08 1748148968

Could not find it. Can you please provide a link?

p0w3n3d · 2025-05-25T19:43:37 1748202217

https://youtu.be/7xTGNNLPyMI?si=eaqVjx8maPtl1STJ

He shows how the prompt is parsed etc. Very nice and eye opening. Also superstition dispelling