They're also somewhat bigger and faster than you expect, which combined with the above would certainly worry me if I was walking and prone to serious injury or death from a fall.
Unicycles are actually very safe.
Since the pedals are fixed to the wheel, there is no free spinning.
Either the rider is above it and in control, or they are on their ass and the uni next to them.