Not only that, but it's the type of situations that will kill you in each case that make a difference too. From the various self-driving related death I've read about, most of them appeared to be situations that could have easily been avoided if a person had been driving and paying full attention. On the flip side, the kinds of situations that kill normal drivers are often ones that a self-driving car could trivially avoid.

So with a self-driving car, you have the mental hurdle of asking people to accept the risk of the car killing them in a situation they could likely have avoided had they been driving, even if it is statistically less likely than them killing themselves while driving.