I do a similar thing using Lima (which uses Qemu under the hood) https://github.com/lima-vm/lima

(I'm not a fan of Docker, but unfortunately work on some projects that use it)