One of the things that llms are mainly not great at is understanding spatial relationship characters to each other. Get chat gpt to convert between different forms of chess notation and you'll start seeing errors very quickly. Ascii art is generally fairly bad unless it's regurgitation. It's not too surprising, but it will make games like nethack harder.
Yeah, I've struggled to get GPT to do ASCII art. I wonder if it's a tokenization thing? If we were to group characters in ASCII art in twos or threes we'd have a hard time making it too!
