Hi Team, I have a requirement where I would need t...
# ask-community
d
Hi Team, I have a requirement where I would need to orchestrate multiple jobs using a master job. Is there anyway I can do this in dagster. Which has a parent job, creates a folder, then trigger all child pipelines to output files into that folder, then the master job to rename that folder after all child jobs have run successfully.
j
Without all the details on your use case, I would probably write this as a single Dagster Job with one op that creates the folder, ops that depend on it that output to it, and a final op that depends on all of those
If you need arbitrary many child ops, you can use dynamic orchestration https://docs.dagster.io/concepts/ops-jobs-graphs/dynamic-graphs#dynamic-graphs