Hello curious if anyone has seen this before I m using Dagst

Question

Hello curious if anyone has seen this before I m using Dagster with dbt on Dagster Serverless connected to Snowflake When running dbt the queries resolve in lt 1s but are consistently taking ~30s to resolve in `dbt build` This doesn t occur when running dbt locally E g in the image attached

jamie · Answer

cc < rex>

James Hale · Answer

< jamie> < rex> any thoughts here

rex · Answer

Could you run your dbt commands in Serverless with ` debug` enabled Our serverless tasks should have more than enough CPU MEM to handle dbt tasks esp since the transformation is happening in the data warehouse anyways

rex · Answer

You could also try turning off usage stats from being sent on `dbt` s side to see if that alleviates some latency <https docs getdbt com reference global configs send anonymous usage stats>

rex · Answer

also dbt uses some caching to help out with running models in local development and that cache might not be hit when run in an isolated environment like serverless <https docs getdbt com reference global configs cache database objects for selected resource>

James Hale · Answer

< rex> looping back around on this I ll take a look at both above However I ve been able to correlate the change with moving from `dagster cloud=1 0 13` to `dagster cloud=1 1 20` Was there perhaps a change to the dockerfile for serverless deploys in that interval

James Hale · Answer

< rex> < jamie> could you advise on how to access dbt s ` debug` flag in the `dagster dbt` integration It doesn t appear to be exposed as an option