https://dagster.io/ logo
#dagster-support
Title
# dagster-support
d

DE-2

04/05/2022, 9:30 AM
Hi Team, I have a requirement where I would need to orchestrate multiple jobs using a master job. Is there anyway I can do this in dagster. Which has a parent job, creates a folder, then trigger all child pipelines to output files into that folder, then the master job to rename that folder after all child jobs have run successfully.
j

johann

04/05/2022, 3:16 PM
Without all the details on your use case, I would probably write this as a single Dagster Job with one op that creates the folder, ops that depend on it that output to it, and a final op that depends on all of those
If you need arbitrary many child ops, you can use dynamic orchestration https://docs.dagster.io/concepts/ops-jobs-graphs/dynamic-graphs#dynamic-graphs
2 Views