I agree $3/month is reasonable for email, but since the encryption backdoor laws passed in Australia in Dec 2018, I've been avoiding Australian software.
Would the Australian encryption laws impact Fastmail that much? AFAIK their emails were never encrypted at rest to begin with so someone with a warrant could always have gotten in.
If you're worried about E2E then I'm not sure what options you have other than maybe proton mail (and then only if both parties are using it) or GPG-encrypting messages, at which point host is irrelevant.
While the legislation introduced by the Australian government is certainly worrying and should never had been enacted, I've always operated under the assumption that if any government agency around the world really wants to get to my encrypted data or traffic, they'll likely be able to use/abuse some sort of loophole in their current processes and laws anyway.
If that's the case then why would the Australian government need to open the door even wider? The implication is that privacy laws pose inconveniences.