Hello hoping for some help I am setting up a dbtcloud resour dagster #integration-dbt

Hello, hoping for some help. I am setting up a dbt...

Noam Jacobson

08/11/2023, 5:43 PM

Hello, hoping for some help. I am setting up a dbtcloud resource and trying to load the assets the way its demoed here: https://docs.dagster.io/integrations/dbt-cloud . I was wondering as to how I would pass the DbtCloudClientResource into Definitions and then use that same resource in the load_assets_from_dbt_cloud_job function? I want to have the capability to execute both individual jobs through an op and as well as have the assets loaded. Is this possible?

yuhan

08/11/2023, 10:21 PM

you should be able to define the dbt cloud resource and pass it to both

Definitions

and

load_assets_from_dbt_cloud_job

Noam Jacobson

08/12/2023, 1:38 AM

I am trying to have both

load_assets_from_dbt_cloud_job

and

dbt_cloud_run_op

but they both use and create the same resource: "dbt_cloud".

Noam Jacobson

08/12/2023, 1:39 AM

I am getting

Could not load location repo.py to check for sensors due to the following error: dagster._core.errors.DagsterInvalidInvocationError: AssetsDefinition with keys has conflicting resource definitions with provided resources for the following keys: dbt_cloud. Either remove the existing resources from the asset or change the resource keys so that they don't overlap.

Noam Jacobson

08/12/2023, 1:41 AM

the

dbt_cloud_run_op

functions picks up the resource from

Definitions

as expected since it looks for "dbt_cloud". But then

load_assets_from_dbt_cloud_job

takes in also a resource param and sets it as well to the same resource name "dbt_cloud". So it conflicts it seems.

Open in Slack

Previous Next