Waqas Awan
02/10/2021, 10:08 AMscheduler:
module: dagster.core.scheduler
class: DagsterDaemonScheduler
run_coordinator:
module: dagster.core.run_coordinator
class: QueuedRunCoordinator
config:
max_concurrent_runs: 25
tag_concurrency_limits:
[
{ key:"test", value:"two", limit:2 }
]
While running the program it says following:
raise DagsterInvalidConfigError(
dagster.core.errors.DagsterInvalidConfigError: Errors whilst loading configuration for {'max_concurrent_runs': Field(<dagster.config.config_type.Int object at 0x7fd295c8ea30>, default=@, is_required=False), 'tag_concurrency_limits': Field(<dagster.config.config_type.Noneable object at 0x7fd29b096dc0>, default=@, is_required=False), 'dequeue_interval_seconds': Field(<dagster.config.config_type.Int object at 0x7fd295c8ea30>, default=@, is_required=False)}.
Error 1: Received unexpected config entries "['key:"test"', 'limit:2']" at path root:tag_concurrency_limits[0]. Expected: "['key', 'limit', 'value']."
Error 2: Missing required config entries "['key', 'limit']" at path root:tag_concurrency_limits[0]".
Error 3: Received unexpected config entries "['key:"test1"', 'limit:5']" at path root:tag_concurrency_limits[1]. Expected: "['key', 'limit', 'value']."
Error 4: Missing required config entries "['key', 'limit']" at path root:tag_concurrency_limits[1]".
I am using the exact syntax based on docs: https://docs.dagster.io/overview/pipeline-runs/limiting-run-concurrency#mainjohann
02/10/2021, 2:42 PMdaniel
02/10/2021, 3:36 PMrun_coordinator:
module: dagster.core.run_coordinator
class: QueuedRunCoordinator
config:
max_concurrent_runs: 25
tag_concurrency_limits:
- key: 'test'
value: 'two'
limit: 2
This is likely a formatting issue in the docs, we'll fix that up or make sure the example there works.Cameron Gallivan
02/10/2021, 6:12 PMCameron Gallivan
02/10/2021, 6:13 PMrun_coordinator:
module: dagster.core.run_coordinator
class: QueuedRunCoordinator
config:
max_concurrent_runs: 25
tag_concurrency_limits:
[
{ key: 'job_type', value: 'onboard', limit: 4 },
{ key: 'random_key', limit: 10 },
]
johann
02/10/2021, 6:16 PMWaqas Awan
02/11/2021, 6:06 AM