Hello All, I'm trying to configure dagster in Google Cloud together with distributed dask, but unfortunately it don't want to work without S3 storage that a little bit strange. As I noticed this storage hardcoded in dagster-dask, but why? There is dagster-gcp that can provides GCS, so maybe possible add it to gaster-dask (or even better make som general requirements)?
02/06/2020, 11:29 AM
This might just be an oversight on our part, as the GCS support was added more recently. We’ll take a look—thanks for flagging!