Channels
dagster-de
topic-async-execution
dagster-jp
dagster-cube
gigs-freelance
dagster-wandb
dagster-feedback
dagster-machine-learning
dagster-bigquery
dagster-support
dagster-dask
dagster-snowflake
dagster-releases
dagster-dbt
faq-read-me-before-posting
tools
dagster-pipes
project-flexible-range-backfills
data-platform-design
events
dagster-serverless
dagster-noteable
introductions
dagster-airflow
dagster-cloud
random
dagster-airbyte
dagster-spatial
announcements
github-discussions
豆瓣酱帮
dagstereo
dagster-ecs
dagster-kubernetes
jobs
dagster-showcase
data-quality-asset-checks
Powered by
#announcements
Title
j
James Green
12/09/2019, 8:53 AM
What are the guidelines for running on GCP? Thank you!
a
alex
12/09/2019, 4:07 PM
👋 the
dagster_gcp
module has some integrations already - happy to collaborate on more.
I’m not sure we have any high level guidelines at this point - happy to answer more specific questions if you have them.
A couple things you may find uesful •
gcs_system_storage
to persist intermediates in gcs
Some guides on configuring dagster/dagit for deployment:
https://dagster.readthedocs.io/en/0.6.6/sections/deploying/instance.html
https://dagster.readthedocs.io/en/0.6.6/sections/deploying/dagit.html#manually-configuring-dagit
you for example may want to configure your run and event storage on your instance to use a Cloud SQL postgres db
j
James Green
12/10/2019, 7:37 AM
Hey
@alex
thanks for the quick response - we’ll read through the docs above.
2 Views
Post