I have this exact same amount of care about the opinions of others (my wife + children matter to me very deeply; everyone else can go fuck themselves) and it hasn't exactly endeared me to others, but personalities are hard to override :)