One of the big things about these projects is training sound that's paired to text.

The base project spoke English because it had been trained on English text paired with English recordings. This speaks Mandarin because it has been trained on paired Mandarin text and recordings.

Amusingly, if you take one trained on English text/recording pairs and feed it French text, it will speak French with an English accent.