https://dagster.io/ logo
Title
s

Stepan Dvoiak

07/08/2021, 10:04 AM
Hi, im playing with DynamicOutput and composite_solid, invoking composite_solid on DynamicOutput my pipeline looks like
dyn_outputs = produce_dyn_outputs()
dyn_outputs.map(compose_plus_two_mul_ten).collect()
is this equal to?
dyn_outputs = produce_dyn_outputs()
dyn_outputs.map(plus_two).map(mul_ten).collect()
where
compose_plus_two_mul_ten
is composite_solid consist of
plus_two
and
mul_ten
solids The question here is: How i can control the order of execution of that 2 solids? Why
plus_two
executes first on all outputs and only than execution of
mul_ten
started Use case: first solid will train model and second commit it to general dvc repo
a

alex

07/08/2021, 2:04 PM
you can use
dagster/priority
tag to influence execution order https://docs.dagster.io/_apidocs/execution#dagster.in_process_executor
s

Stepan Dvoiak

07/08/2021, 2:12 PM
Thanks, will try it