The problem isn't friction from the grip (that can occasionally pop up), the issue is when you hit the wrong spot and the energy of the ball gets dumped entirely into your hands instead of evenly distributed through the bat.
It just doesn't help that much to be worth the change in mechanics and the compromise on grip strength - too much energy, too quickly to effectively dissipate. I stopped playing competitively in my teens and I still remember how much that hurts.