https://dagster.io/ logo
n

nate

11/05/2019, 12:17 AM
hey Zachary! that’s awesome. we haven’t done any work w/ Cloud Composer specifically yet, but I don’t see any reason why our
dagster-airflow
integration wouldn’t work on CC. For other GCP integrations, we’ve done some early work w/ BQ and Dataproc in a library here: https://github.com/dagster-io/dagster/tree/master/python_modules/libraries/dagster-gcp - generally we’re trying to build an ecosystem of modular libraries that work on top of Dagster for things like this. So, I think either
dagster-airflow
or
dagster-gcp
would be the right place to experiment with a
DagsterGKEPodOperator
, but this isn’t something we’ve explicitly worked on yet!