Jérémie Bouhet04/01/2022, 9:30 AM
owen04/01/2022, 4:47 PM
. The bronze dbt project would read from the production data source, but output to a staging schema (and the silver / gold projects would read from / write to staging schemas as well). Only once the data quality check has passed will these tables get promoted to production. We have libraries for interacting with both dbt and snowflake (dagster-dbt and dagster-snowflake) which should make those bits pretty quick to set up.
bronze dbt run -> silver dbt run -> gold dbt run -> data quality check on staging tables -> swap staging tables to prod