Except the people doing the tracking already know where you live, and in this case, own the land you live on, so I'm not at convinced that this amounts to any kind of loss.
Guests are tracked in plenty of apartment buildings. Sure, many might not bother with strictly policing guests but effectively every apartment building I lived in reserved the right to manage who comes in and out of the building.
