The "n" sound denoting negative seems deeply ingrained in English (and also in this native English speaker). So Finnish "niin" for affirmative took a very long time to get used to, and to actually begin using. It just felt wrong.
It goes even deeper than just English. No descends from the Indo-European negation phoneme *ne. You see similar 'n' sound negative words in pretty much every IE language group.
Japanese Hai = yes, Xhosa - Hai is a no
Japanese eeye = no, Xhosa - ewe is yes