I use Zed with SSH support daily, most often to SSH into a distrobox dev container running on localhost. It's a little jank but it works great for the most part.
Note that Zed has the aforementioned concern around downloading a remote binary as well. In my case this isn't an issue, since the distrobox container is not a security boundary of any kind.
