https://dagster.io/ logo
#announcements
Title
# announcements
r

Rubén Lopez Lozoya

03/27/2021, 3:05 PM
Hey, how can I specify the node to be used by the K8sRunLauncher jobs? I see that there is a nodeSelector for the CeleryK8sRunLauncher but not for K8sRunLauncher. Same question about resource limits for jobs.
a

alex

03/29/2021, 3:33 PM
cc @rex
r

rex

03/29/2021, 3:46 PM
Hey Ruben, you can configure arbitrary kubernetes settings for the K8sRunLauncher jobs by using tags. https://docs.dagster.io/deployment/guides/kubernetes/customizing-your-deployment#solid-or-pipeline-kubernetes-configuration
r

Rubén Lopez Lozoya

03/29/2021, 3:48 PM
Is there any practical way to ensure that all the pipelines in a repo run using the same tag? Or do I have to specify the same tags manually to all the pipelines. It would be ideal if I could use the helm chart so that I specify once the nodeselectors and all my runs will be scheduled to those nodes.
r

rex

03/29/2021, 3:53 PM
currently you’d have to specify the same tags for all pipelines - but feel free to file a feature request on this, this seems like a reasonable request
r

Rubén Lopez Lozoya

03/29/2021, 3:53 PM
cool, thanks Rex!
2 Views