But this implies that even the guests who never went to that restaurant and have no links whatsoever to it might somehow still be directly suffering because of its presence.

In reality this doesn’t seem to be the case at all.