Hey there, are there any simple examples of running a
model inside of BigQuery using dagster?
12/23/2022, 12:18 AM
Our guide does it with DuckDB just so you don’t need to set up an external data warehouse: https://docs.dagster.io/integrations/dbt.
But it can easily extend to running in BigQuery. Dagster runs whatever configuration your dbt project is set up with anyways. So if you project’s dbt profile is already set up with BigQuery, you’re good to go.
If not, you can follow dbt’s guide to set up your project to run in BigQuery: https://docs.getdbt.com/reference/warehouse-setups/bigquery-setup
If you have further questions, ask them in #dagster-dbt
12/23/2022, 12:26 AM
Do I also need to setup the IO Manager step or can that be skipped?
12/23/2022, 12:29 AM
That can be skipped - you only need to set that up if you want to load your dbt models as pandas dataframes for downstream computations