Trying to figure out how to use the docker-executor. Currently I have dagster setup as a single container not using the user code grpc run launcher. From the documentation it seems like I can configure a job to use a docker-executer and run a job in a docker container. I can’t seem to find documentation on where you set the config schema and call the job. What I am trying to do is run majority of the jobs in the base container where the dagster workspace is installed, but there are some jobs in the pipeline where I would want to spawn off with another docker image/container. Please let me know if this is possible.
12/02/2022, 1:49 AM
Hi Uddhav - what you're describing sounds like the run launcher to me, which controls where the whole run executes. Unfortunately we don't currently have a way to vary the run launcher for individual jobs. If that's something that would be useful for you would you mind filing a feature request issue?