Hi, I have a question on the DockerRunLauncher. This may have been asked before but Slack doesn't show messages older than 90 days...Specifically, I use a host for Dagit and another for the user code server. If I use DockerRunLauncher to execute jobs, are the containers created on the Dagit host or the user code host? It wasn't very clear in the documentation https://docs.dagster.io/deployment/guides/docker I assume it is the user code server but just want to confirm. Thank you.
01/04/2023, 6:27 PM
Hi Jing - are you running the dagster daemon in a container as well?
https://docs.dagster.io/deployment/guides/docker#multi-container-docker-deployment lays out when you would have one - if you have a run queue set up on your daemon, every run will be launched using the daemon container on the same machine where that container is running.
If you don't have a run queue, then runs kicked off manually from dagit will be launched from the dagit container, but other runs (schedules and sensors) will be launched from the daemon container
01/04/2023, 6:36 PM
Thanks Daniel! Sounds like I need 3 host, one for dagit, one for the daemon with a queue and one for the user code vm. In this case, all the job containers are created on the daemon host?
01/04/2023, 6:37 PM
I would expect them to also work on a single host too (the daemon in particular doesn’t need to run as a server)
It’ll either be on the daemon machine or the dagit machine - my comment just above lays out the different cases