To an untrained juror, even regular computer code is a black box whose behaviour is entirely unpredictable.

The only difference between a neural net and regular logic is that the latter has someone who claims to understand it.