No, that's fine, it's probably true, but that's not a bad thing that we're condemning.
You are evidently very unwilling to accept the claim, so I don't think anything said here will convince you otherwise, but perhaps it is meaningful that so many people are convinced of it.
The point is that he exposes the entire spectrum and even leans left himself, however the original commenter only mentioned the alt-right. Clearly they're implying one side is worse and somehow going to unleash terrible things, however these claims are vague, misleading, and usually made by those who just happen to be on the other extreme.
Very few people have such trouble with his massive variety of guests, topics and politics; otherwise it wouldn't be the most popular podcast in the world.
You are evidently very unwilling to accept the claim, so I don't think anything said here will convince you otherwise, but perhaps it is meaningful that so many people are convinced of it.