https://dagster.io/ logo
Title
a

Arun Kumar

09/30/2021, 11:10 AM
Hi team, just curious if it is possible to switch between
DefaultRunLauncher
and
K8sRunLauncher
for different pipelines? We currently use
K8sRunLauncher
by default. However certain pipelines are very cheap (eg: just triggers an API) and can be easily executed as a process and use
DefaultRunLauncher
d

daniel

09/30/2021, 11:33 AM
Hi Arun - this isn't currently possible, but it's close to the top of a list of several improvements we'd like to make to the run launchers / executor setup
you could write a custom run launcher that delegates to each of the two possible run launchers based on a tag on the pipeline though
a

Arun Kumar

09/30/2021, 5:55 PM
Thanks @daniel Do you have any idea on approximately when the team might get to working on this feature? If its not too long, I would probably wait as it is not a big issue. Otherwise, I will start looking into implementing a custom run launcher
Quick follow up: For inprocess executor, does the pipeline run inside the daemon or user code?
d

daniel

09/30/2021, 6:09 PM
User code - dagit and the daemon never execute pipeline code directly
We don’t have a specific timeline on the run launcher improvements, so it may be a while
👍 1
One thing to watch out with the DefaultRunLauncher - since it is running on the user code deployment, updating your user code deployment can disrupt running pipelines
:thankyou: 1