

I know you asked about VMs, but fwiw there are GPU-capable containers now: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html
Used one of these and the setup is as easy as it sounds. It can run Houdini, Stable Diffusion.
With Gitea/Forgejo you can run a local actions executor, which builds the images, pushes to gitea’s image registry, and using a script pulls them on the other side and restarts them. Worked fine in our small startup.