Hello I have been moving my data pipeline into the dagster w

Question

Hello I have been moving my data pipeline into the dagster workflow Some of our solids are slow so on top of refactoring the code we want to use `async` where possible I am having a little issue trying to get a basic working example to execute asynchronously As of now the basic example solids execute one after another I saw in the docs that `execute pipeline iterator` might have to be used I was wondering if there was any async execution for dagit dagster cli apart from `execute pipeline iterator` and if I could get some help on my example Appreciate any and all help

Jordan W · Answer

Example ``` solid async def do stuff context await asyncio sleep 5 <http context log info|context log info> hello yield Output 42 pipeline def sample async pipeline do stuff do stuff ```

johann · Answer

cc < alex>

alex · Answer

we do not yet support simultaneous execution of solids in the same process you can set execution to multiprocess for parallelism in the `run config` you can set ``` execution multiprocess storage filesystem ```

Jordan W · Answer

thank you i was able to get it working after using these params

Jordan W · Answer

after applying this to my solids when the solid finishes executing it throws this error the solid returns a NamedTuple ```dagster core errors DagsterObjectStoreError Error occurred during storing output result for step solid name in filesystem object store using pickle AttributeError Can t pickle local object solid name lt locals gt lt lambda gt was wondering if this error ``` Edit Think i cant pickle a default dict not a dagster issue