You're right about Japanese names in general, but current LLMs' mistakes can go far beyond the range of possible readings. I've seen errors on the level of 田中 (Tanaka) being rendered as Suzuki--in other words, one common name being replaced with another.
I'm sure this problem can be solved. The linked article suggests a promising approach--more and better Japanese data.
I'm sure this problem can be solved. The linked article suggests a promising approach--more and better Japanese data.