Chris Roth02/07/2023, 11:39 PM
when deploying on k8s Our run coordinator includes the following:
run_coordinator: module: dagster._core.run_coordinator class: QueuedRunCoordinator config: max_concurrent_runs: 2 tag_concurrency_limits: - key: catalog limit: 4 value: iceberg
are decorated with
Yet, more than 4 of these ops will process concurrently. The ops are being spawned by a
. Is this a special case where I need to do something differently? We'd like to limit the number of spawned ops that access one of our databases.
daniel02/07/2023, 11:43 PM
Chris Roth02/08/2023, 2:04 AM