I'm much more likely to upvote a post if it's grey, and much less likely to downvote it. I think you'd see a lot more downvoting if you removed the grey effect.