Yes you are right about the greater variation being localised. But I thought it was localised at the level of linkage disequlibrium blocks which can encompass many thousands of genes at their largest.

Regardless the genetic distance between any two people remains tiny compared to the distance between even closely related species or sub-species elsewhere.