It’s almost as though you have to treat them like human drivers. We cannot formally verify 16 year olds, either, or sufficiently introspect accurate reasons for their behavior. Instead, we require them to pass a test, we apply actuarial cost models, etc.
You can figure what the Tesla NN would say if they built an explanatory speech system in. Something like "Opps sorry - I thought that which line was a lane and didn't recognise the barrier." Not all that helpful here really.
