Those are still consequences. If people of color are given more slack for racist comments it could be because they're perceived as punching up, whereas white people would be considered punching down. Whites are the majority and certainly control more money and political power in the US.