Jens Geyti
06/26/2023, 1:27 PMrun_queue:
max_concurrent_runs: 15
tag_concurrency_limits:
- key: "database"
value: "redshift" # applies when the `database` tag has a value of `redshift`
limit: 4
- key: "dagster/backfill" # applies when the `dagster/backfill` tag is present, regardless of value
limit: 10
run_coordinator:
module: dagster.core.run_coordinator
class: QueuedRunCoordinator
config:
max_concurrent_runs: 25
tag_concurrency_limits:
- key: "database"
value: "redshift"
limit: 4
- key: "dagster/backfill"
limit: 10
erin
06/26/2023, 2:16 PMrun_queue
key like that in the first example will enable the QueuedRunCoordinator
and apply any tag limits you’ve defined.Jens Geyti
06/27/2023, 12:01 PM