Akira Chang
05/25/2023, 10:29 AMscheduled jobs
to run one run at a time.
For example, I have a job that is scheduled to run now. But it takes 1 hour to finish running the job.
If the schedule is set to 2 minutes, is there a way to queue the second run? wait for the first run to finish and then execute the second run?Adam Bloom
05/25/2023, 12:20 PMQueuedRunCoordinator
, you could set a tag on that job and only allow one job of that tag to run. See https://docs.dagster.io/guides/limiting-concurrency-in-data-pipelines for a whole lot more infoAkira Chang
05/25/2023, 12:44 PMrex
05/25/2023, 12:45 PMAkira Chang
05/25/2023, 12:57 PMAkira Chang
05/25/2023, 12:59 PMrex
05/25/2023, 1:02 PMQueuedRunCoordinator
to enforce a limit of 1
on that tag
• Then you will get the behavior you want.
You’ll want to follow this section instead: https://docs.dagster.io/guides/limiting-concurrency-in-data-pipelines#configuring-run-level-concurrencyAkira Chang
05/26/2023, 7:42 AM