Hello there! Is there a way to limit the number of parallel

op

run in a

job

?

hi @Antoine Valette! If you're using the multi process executor (which is the defualt), you can configure

max_concurrent

to specify the maximum number of concurrently running ops: https://docs.dagster.io/concepts/ops-jobs-graphs/job-execution#default-job-executor

Thanks a lot, very clear! Is there a way for the Docker or Kubernetes executor?

Isn't it working for Docker too? I think I saw that my 4 way job was working only with 2 jobs in parallel mode while I was testing it with concurrency limit

Let me try that! Thanks a lot for the help.