Most customers don't care the only reason it's a real issue is Twitter users run the marketing department at a lot of companies and they are incorrectly convinced people care.
How much is "most"? What data do you have? Plus, even if ~20% of customers care and only half will boycott, that's still going to have an impact on the company's bottom line.
