Hello Is it possible for the ops spawned from a DynamicOutpu

Question

Hello Is it possible for the ops spawned from a DynamicOutput to run as they are yielded or does the DynamicOutput have to finish processing before all parallel tasks can execute

Tony · Answer

To clarify using the process directory example from the docs Is it possible to use the DynamicOutput to run an op against each yielded file as soon as it is yielded instead of waiting for the entire directory to be crawled

chris · Answer

unfortunately no the downstream ops will wait until all upstream deps have finished executing

Tony · Answer

That s unfortunate Are there any suggested work arounds for accomplishing that

chris · Answer

hmm One workaround is instead of using dynamic outputs you actually just launch off entirely separate runs

chris · Answer

so instead of yielding a dynamic output for each file in the directory you send a run request

chris · Answer

via graphql or something

Tony · Answer

Thanks I ll try giving that a try