Hello everyone! My team is using K8sRunLauncher + ...
# ask-community
i
Hello everyone! My team is using K8sRunLauncher + k8s_job_executor and using DynamicOutputs to execute tasks in parallel. Is there any way to limit the number of pods executed in parallel by the executor when I have yielded a lot of DynamicOutputs ? I've tried using 'dagster-k8s/config' tags and had no success.
y
cc @johann
j
Hi Igor, a user contributed a feature that will go out next week: https://github.com/dagster-io/dagster/pull/7752 This limits the number of concurrent pods per run
i
That's nice! Thanks a lot!