It becomes harder and harder--and harder still if you also don't want to use email, etc. You're an edge case and institutions tend to forget about edge cases or just don't want to be bothered with them. So, for example, you now need to show up in offices because you can't sufficiently validate your identity otherwise.

I actually know one senior person in Silicon Valley who refused for years to get a cell phone and only relented when his nanny insisted after he and his wife adopted a child. I think he still doesn't have a personal smartphone although his current employer gave him a company phone to carry.