Hey Team, There is a way to limit only one job or ...
# ask-community
e
Hey Team, There is a way to limit only one job or tag in the Queue?
m
Not sure this is what you are going for but this might help https://docs.dagster.io/deployment/run-coordinator#limiting-run-concurrency
e
I’m still not getting how to limit number of the the same job or uniq tags in the queue. Now I it runs one job at the same time rest other go to the queue. If a job get stuck the queue grows. My goal is to have only one uniq job(tag) in the queue and skip adding more the same job(tag)
m
I've been reading the documentation and haven't come across anything that sounds like it would satisfy your needs. Maybe this could be a feature request.
p
We don’t have anything out of the box that does this. One way you could try to get there yourself is to implement your own run coordinator that queries the in-progress / queued runs and automatically cancels runs that have tag/job collisions in the queue upon submission.
e
Seems like I have to dig into the dagster source code 🤪 Thank you guys!
p
I’d start from looking at the QueuedRunCoordinator, potentially subclassing it and overriding the
submit_run
method
👍🏼 1
e
Awesome! Thank you man!