https://dagster.io/ logo
Title
c

Charlie Bini

03/23/2023, 8:24 PM
Not sure if I'm doing something wrong or something's buggy, but I'm trying to run a backfill with
container_config
tags to adjust the resources for all pods. I see the resource adjustment show up on the
dagster-run-...
pod, but it doesn't propagate to the pods for each step
this is the tag as it appears in the run config:
dagster-k8s/config:{"container_config": {"resources": {"limits": {"memory": "1.0Gi"}}}}
d

daniel

03/23/2023, 8:42 PM
Hey Charlie - setting that tag at the @job level doesn't actually propagate to each step - we went back and forth about whether it should, but landed on that you might actually want quite different resources for the run worker and individual steps
c

Charlie Bini

03/23/2023, 8:46 PM
ah ok
so there's no way to set a run config for multiple partitions right?
like on this modal, there isn't a shift+click option
d

daniel

03/23/2023, 8:50 PM
I don't believe so, yeah