https://dagster.io/ logo
k

Krishna Medikeri

08/13/2019, 1:10 PM
Hi everyone, I'm new to dagster and looking for an example for running independent solids in parallel. I appreciate your help in advance!
a

alex

08/13/2019, 3:01 PM
Hi Krishna! Here is a very contrived example where solids can execute in parallel https://github.com/dagster-io/dagster/blob/master/examples/dagster_examples/toys/sleepy.py Dagit will execute in single process mode by default which will lead the solids to execute in serial. https://dagster.phacility.com/D771 added the ability to use multiprocess executor from dagit and should go out in the 0.5.6 release.