The term for this "communal freedom" rather than "pure individualist freedom" is Negative Liberty: https://en.wikipedia.org/wiki/Negative_liberty

It's one of the core tenets of modern freedom, for example: you're free to say what you want (Positive Liberty) as long as it's not a threat of violence that would silence someone else, so that other person is free from your threat of violence (Negative Liberty).