https://dagster.io/ logo
#dagster-kubernetes
Title
# dagster-kubernetes
c

Caio Tavares

12/15/2022, 7:52 PM
hey all, is there a way to add a nodeAffinity for Dagster jobs to run only on a specific node in the Helm Chart? Essentially, I'd like to have all
dagster-steps-*
running on a pool of nodes which has more resources available.
a

Andrea Giardini

12/15/2022, 7:54 PM
c

Caio Tavares

12/15/2022, 7:55 PM
Hi @Andrea Giardini I've seen this but I was hoping/checking whether or not the Helm Chart supports affinity for the jobs rather than defining in code.
a

Andrea Giardini

12/15/2022, 7:56 PM
mmmm do you want to apply the same affinity to all the jobs?
c

Caio Tavares

12/15/2022, 7:56 PM
That's correct
a

Andrea Giardini

12/15/2022, 7:58 PM
You could create a custom
op
that automatically adds the correct
dagster-k8s/config
. I don’t think what you’re trying to do is achievable only using the helm chart, but i might be wrong 🤔
m

Mark Fickett

12/15/2022, 8:16 PM
In the agent Helm chart values I see a way to set affinity/taints on the agent's pod, but not on under
workspace
which I think is what you might need.
d

Daniel Galea

12/16/2022, 10:26 AM
Hey Caio, the HELM chart contains these three configurations for each service:
nodeSelector: {}
affinity: {}
tolerations: []
Isn't affinity here what you're looking for? Personally I've used nodeSelector instead and all Dagster Pods are launched on the same node group. However, this is not limited to just jobs but to all pods
9 Views