https://dagster.io/ logo
#ask-community
Title
# ask-community
i

Ismael Rodrigues

07/26/2023, 5:21 PM
This does not work for jobs that already have a configuration input on OPs, you'll get the following error: Error 1: Missing required config entry "ops" at the root. Sample config for missing entry:
s

sandy

07/28/2023, 11:32 PM
can you explain what you mean in a little more detail by "already have a configuration input on OPs"?
i

Ismael Rodrigues

07/29/2023, 1:07 PM
Suppose you have a op like this:
Copy code
@op
def my_op(context, config: MyClassConfig):
     pass
This op will require from you to define in somewhere:
Copy code
{
  "ops": {
      "my_op": {
            "config": {
                "date": '2023-01-01'
             }
      }
}
Something like this, and the point is, that if you have this config in your OP, you can't define the configuration to limit concurrency of OPs, because it'll require that you also configure this other thing that is supposed to be configured by schedule, sensor or partition definition
s

sandy

07/30/2023, 3:15 PM
ahh I see. I think you can address that with this:
Copy code
@job(executor_def=multiprocess_executor.configured({"max_concurrent": 4, ...}))
def tag_concurrency_job():
    ...
❤️ 1