Is there any way to do a fan-out of solids? Like a...
# announcements
n
Is there any way to do a fan-out of solids? Like an output value is an array and the pipeline iterates over it and sets one solid for each? It seems like that kind of map-reduce model isn't really supported since the DAG has be known statically.
s
Correct. That is the current state of things. Dynamically unrolling DAGs (we call it dynamic orchestration to make it clear that it is not supposed to be a map reduce engine) are on the roadmap but no definite date as of yet!
s
Coming from Prefect, I love every aspect of Dagster, the concepts you introduced seem really well-thought, but “dynamic orchestration” is definitely a crucial feature for me (and a lot of people I’m sure) since pretty much all my tasks are dynamically unrolled depending on the input data. I second this feature 👍
s
Well it was just released yesterday! It is experimental but it is there 🙂
s
My bad! Thanks for the heads up!