https://dagster.io/ logo
#announcements
Title
# announcements
w

Waqas Awan

02/10/2021, 10:08 AM
Hi Everyone! I am getting strange error while setting up concurrency configurations: dagster.yaml
Copy code
scheduler:
  module: dagster.core.scheduler
  class: DagsterDaemonScheduler


run_coordinator:
  module: dagster.core.run_coordinator
  class: QueuedRunCoordinator
  config:
    max_concurrent_runs: 25
    tag_concurrency_limits:
      [
        { key:"test", value:"two", limit:2 }
      ]
While running the program it says following:
Copy code
raise DagsterInvalidConfigError(
dagster.core.errors.DagsterInvalidConfigError: Errors whilst loading configuration for {'max_concurrent_runs': Field(<dagster.config.config_type.Int object at 0x7fd295c8ea30>, default=@, is_required=False), 'tag_concurrency_limits': Field(<dagster.config.config_type.Noneable object at 0x7fd29b096dc0>, default=@, is_required=False), 'dequeue_interval_seconds': Field(<dagster.config.config_type.Int object at 0x7fd295c8ea30>, default=@, is_required=False)}.
    Error 1: Received unexpected config entries "['key:"test"', 'limit:2']" at path root:tag_concurrency_limits[0]. Expected: "['key', 'limit', 'value']."
    Error 2: Missing required config entries "['key', 'limit']" at path root:tag_concurrency_limits[0]".
    Error 3: Received unexpected config entries "['key:"test1"', 'limit:5']" at path root:tag_concurrency_limits[1]. Expected: "['key', 'limit', 'value']."
    Error 4: Missing required config entries "['key', 'limit']" at path root:tag_concurrency_limits[1]".
I am using the exact syntax based on docs: https://docs.dagster.io/overview/pipeline-runs/limiting-run-concurrency#main
j

johann

02/10/2021, 2:42 PM
This is strange. Could you try copying the exact config block from the docs just to sanity check
d

daniel

02/10/2021, 3:36 PM
Hi Waqas - try this instead:
Copy code
run_coordinator:
  module: dagster.core.run_coordinator
  class: QueuedRunCoordinator
  config:
    max_concurrent_runs: 25
    tag_concurrency_limits:
      - key: 'test'
        value: 'two'
        limit: 2
This is likely a formatting issue in the docs, we'll fix that up or make sure the example there works.
c

Cameron Gallivan

02/10/2021, 6:12 PM
I ran into the same problem, there needs to be spaces after the colons when defining key, value and limit:
Copy code
run_coordinator:
  module: dagster.core.run_coordinator
  class: QueuedRunCoordinator
  config:
    max_concurrent_runs: 25
    tag_concurrency_limits:
      [
        { key: 'job_type', value: 'onboard', limit: 4 },
        { key: 'random_key', limit: 10 },
      ]
👍 1
j

johann

02/10/2021, 6:16 PM
Thanks both, fixing the issue on the docs.
w

Waqas Awan

02/11/2021, 6:06 AM
Thanks @Cameron Gallivan it worked for me.
2 Views