https://dagster.io/ logo
#deployment-ecs
Title
# deployment-ecs
d

dixel

12/20/2021, 2:50 PM
Hi there! Is there something similar to https://docs.dagster.io/deployment/guides/kubernetes/deploying-with-helm-advanced (per-ops limits/resource queues) for ECS? Checking the options to control the requests concurrency when it comes to the databases.
d

daniel

12/20/2021, 8:22 PM
Hi Vasilii - we don't have this at the op level yet (the first thing we would need to build to support this is an ECS executor, to let you run each op in its own ECS task - right now we only support running the whole job in a single task). We do have it at the job level, with the tag_concurrency_limits config setting here: https://docs.dagster.io/deployment/run-coordinator#run-limits
(you could have a tag for a given resource, and enforce a rule that at most N jobs with that tag can be running at once)
3 Views