Channels
dagster-de
topic-async-execution
dagster-jp
dagster-cube
gigs-freelance
dagster-wandb
dagster-feedback
dagster-machine-learning
dagster-bigquery
dagster-support
dagster-dask
dagster-snowflake
dagster-releases
dagster-dbt
faq-read-me-before-posting
tools
dagster-ext
project-flexible-range-backfills
data-platform-design
events
dagster-serverless
dagster-noteable
introductions
dagster-airflow
dagster-cloud
random
dagster-airbyte
dagster-spatial
announcements
github-discussions
豆瓣酱帮
dagstereo
dagster-ecs
dagster-kubernetes
jobs
dagster-showcase
data-quality-asset-checks
Powered by
#announcements
Title
k
Krishna Medikeri
08/13/2019, 1:10 PM
Hi everyone, I'm new to dagster and looking for an example for running independent solids in parallel. I appreciate your help in advance!
a
alex
08/13/2019, 3:01 PM
Hi Krishna! Here is a very contrived example where solids can execute in parallel
https://github.com/dagster-io/dagster/blob/master/examples/dagster_examples/toys/sleepy.py
Dagit will execute in single process mode by default which will lead the solids to execute in serial.
https://dagster.phacility.com/D771
added the ability to use multiprocess executor from dagit and should go out in the 0.5.6 release.
Post