Easy, just learn to push back or setup mechanisms like office hours to attend for folks whom are in need of support.

Like security, the human chain will always be the weakest link here. If you don't have backbone to stand up for your own time, that's on you - not the remote work inherently IMO.