https://dagster.io/ logo
m

max

11/26/2018, 9:54 PM
Right now our machinery for enabling this is a bit clunky. We could set a global flag in the context, but then need to rewrite each individual solid to switch on that flag -- this is especially tricky when you think about wanting to use library solids without too much customization, and when you think about diamond topologies where the alternative sub-DAGs are relatively complex. We could also make the solids themselves more complex, for instance replacing
load_to_redshift
and
load_to_postgres
with a highly configurable generic
load_to_database
.