https://dagster.io/ logo
Title
i

Issac Loo

02/02/2023, 5:22 PM
How do I limit the number of concurrent ops across all jobs (i.e., set max_concurrent to 4 without explicitly setting the config for each job)? I looked at this but couldn’t find an example of how to do that
j

jamie

02/02/2023, 5:48 PM
Hey @Issac Loo this isn’t currently possible, but you could write a custom @job decorator that wraps the dagster job decorator and adds the concurrency tags
d

daniel

02/02/2023, 6:36 PM
You can also configure a default executor on your Definitions object (or repository) :
from dagster import multiprocess_executor, Definitions
my_executor = multiprocess_executor.configured({"max_concurrent": 4})

defs = Definitions(..., executor=my_executor)
:dagster: 1
🙏 1
i

Issac Loo

02/02/2023, 6:43 PM
thanks all!