Hi. How would you suggest limiting mapped task con...
# announcements
s
Hi. How would you suggest limiting mapped task concurrency in Dagster? (similar to this, to prevent 900+ concurrent DB calls)
n
If you're running on Celery and K8s, you can use Keda or something like it with a maximum number of workers. One of my projects is capped at 4 executor workers so anything beyond that will just chill in the queue as long as needed.