Yeah: Like with self-driving vehicles, the characteristics of when and how something breaks are important, not just some average error-rate.

If users cannot anticipate what does or doesn't constitute risky usage or potential damages, things go Extra Wrong.