Similar use case for me. But instead of SSH/SFTP I was running Caddy with the file_server directive!
I've since switched to podman because my installation on Alpine Edge kept breaking on updates and I don't want to use Snap. Someone mentioned OpenSuse had it in their package manager and its been stable. Maybe I'll check that out in the future.
Literally all that is installed is Alpine Linux and the SSH server. There's a symbolic link to get to the shared files.