hey all, is there a way to add a nodeAffinity for ...
# deployment-kubernetes
c
hey all, is there a way to add a nodeAffinity for Dagster jobs to run only on a specific node in the Helm Chart? Essentially, I'd like to have all
dagster-steps-*
running on a pool of nodes which has more resources available.
a
c
Hi @Andrea Giardini I've seen this but I was hoping/checking whether or not the Helm Chart supports affinity for the jobs rather than defining in code.
a
mmmm do you want to apply the same affinity to all the jobs?
c
That's correct
a
You could create a custom
op
that automatically adds the correct
dagster-k8s/config
. I don’t think what you’re trying to do is achievable only using the helm chart, but i might be wrong 🤔
m
In the agent Helm chart values I see a way to set affinity/taints on the agent's pod, but not on under
workspace
which I think is what you might need.
d
Hey Caio, the HELM chart contains these three configurations for each service:
nodeSelector: {}
affinity: {}
tolerations: []
Isn't affinity here what you're looking for? Personally I've used nodeSelector instead and all Dagster Pods are launched on the same node group. However, this is not limited to just jobs but to all pods