It's not about political correctness. It's about what these people make you feel, and how you respond to it. People want to believe that somebody whom they like on one score - Linus's technical achievements, Donald Trump's ability to empathize with the working class and the poor - are likable on all scores.
It's much like the classic literary 'harsh father' figure - he may beat you, he may be strict, he may never show love, but he provides for the family and he teaches you to be moral, so everything he did must have been good. The beatings must have had a purpose. It's hard for us to accept that good and bad exist in the same person, and that somebody who does good things may also do very bad things, not just discretely, but often at the same time.
He's very clear in that he doesn't care about how you feel. If you understand that, and also you're ok with the idea that kernel's code quality is above everything, then join the team, else just use the product... or not.
I think your approach is reasonable, but lots of people on HN do not take it, and suggest that people who don't like it are the ones who are wrong. That is, they genuinely think the way he behaves should be aspired to. I agree that I can't change it myself, but that doesn't mean I support it.
It's much like the classic literary 'harsh father' figure - he may beat you, he may be strict, he may never show love, but he provides for the family and he teaches you to be moral, so everything he did must have been good. The beatings must have had a purpose. It's hard for us to accept that good and bad exist in the same person, and that somebody who does good things may also do very bad things, not just discretely, but often at the same time.