https://dagster.io/ logo
d

Dennis

12/22/2020, 2:04 AM
Is it/Would it be possible to mark a
pipeline
as a "singleton"? I have a pipeline that is rather memory/resource intensive and I would like to prevent multiple instances of it being launched, and instead have it wait until the previous run has ended (or even error out if it has to be that way)
d

daniel

12/22/2020, 2:12 AM
Hi Dennis- we have a run queuing feature coming out in the 0.10.0 release in a couple weeks that should allow you to do exactly this. You can label the pipeline with a tag and then specify a limit of the number of runs with that tag that can be running at once.
👍 1
d

Dennis

12/22/2020, 5:41 AM
Wow, that's great!