https://dagster.io/ logo
r

river_shah

10/22/2020, 8:55 PM
Hi, I have some existing workflows written using luigi that I'd like to migrate to dagster. luigi uses the concept of tasks that the user subclasses and then a workflow is a hierarchical, object oriented, dependency representation. what examples may I look at for dagster to get going at migrating the work flows please?
some example code here: https://www.promptworks.com/blog/configuring-complex-luigi-pipelines/ how do I split up dagster pipelines in this manner please?
m

max

10/22/2020, 9:21 PM
hi, not super familiar with luigi but looking at the example you linked, i think that solids roughly correspond to the
run
methods on the luigi Tasks
then the requirements/ dependency graph is built up separately in Dagster pipelines