I have several graphs I want to be able to run ind...
# ask-community
p
I have several graphs I want to be able to run individually but also to execute all of them together, mostly in parallel. There is one dependency: the first graph needs to run and when it's done, the rest of the graphs should kick off in parallel. All of the graphs run successfully independently. I currently run the first graph manually, then use a script to kick off the rest of the graphs in parallel. I've made some attempts but it just doesn't seem possible from what I can find in the documentation? Thanks
c
A few different ways you can tackle this: Encode explicit dependencies on the first graph in your downstream graphs:
Copy code
@graph
def upstream():
    ...

@graph
def downstream_n(upstream):
    ...

@job
def run_downstream_in_parallel():
    a = upstream()
    downstream_1(a)
    downstream_2(a)
    downstream_3(a)
    ...
Another option is run status sensors, where you kick off runs to the downstream graphs once the first graph finishes.