I have a requirement where I would need to orchestrate multiple jobs using a master job. Is there anyway I can do this in dagster. Which has a parent job, creates a folder, then trigger all child pipelines to output files into that folder, then the master job to rename that folder after all child jobs have run successfully.
04/05/2022, 3:16 PM
Without all the details on your use case, I would probably write this as a single Dagster Job with one op that creates the folder, ops that depend on it that output to it, and a final op that depends on all of those