Dean Morin
01/03/2023, 11:29 PMdepends_on_past
option in DAGs where a scheduled DAG run won’t kick off until the DAG run preceding it finishes successfully. What’s the recommended way to achieve this in Dagster?Joe
01/04/2023, 2:17 AMshould_execute
function on your schedule
2. define a RunStatusSensor that runs whenever the last job completes
Also worth noting that Dagster doesn't have as many of the same noisy neighbor issues that exist/existed in airflow(that were addressed with pooling and other features like depends_on_past
) so if your mostly looking to avoid having a bunch of inflight jobs you shouldn't need to worry about that as muchDean Morin
01/05/2023, 2:00 AMJoe
01/05/2023, 2:38 AMmax_active_runs
run airflow