so I have a working dbt set of models and when I try to use

Question

so I have a working dbt set of models and when I try to use the load assets from dbt project poointing to my dbt project I get the error Error loading repository location myproject dagster dagster core errors DagsterImportError Encountered ImportError `cannot import name load assets from dbt project from partially initialized module myproject dagster most likely due to a circular import

rex · Answer

We ll need more information to diagnose your error Could you show the snippet of code where you re using `load assets from dbt project` How are you invoking dagit

Mike Needham · Answer

from myproject dagster import load assets from dbt project from dagster import file relative path DBT PROJECT PATH = file relative path file dbt project project1 DBT PROFILES = file relative path file dbt project project1 dbt assets = load assets from dbt manifest dbt project project1 target dbt assets = load assets from dbt project project dir = DBT PROJECT PATH profiles dir=DBT PROFILES key prefix= project1

Mike Needham · Answer

this is just from a scaffold project

Mike Needham · Answer

and just running dagit from the terminal

Mike Needham · Answer

using vscode remotely on a linux dev box

rex · Answer

you should be importing load assets from dbt project from dagster dbt

rex · Answer

its a separate package you need to install

rex · Answer

we have a guide here <https docs dagster io integrations dbt using dbt with dagster part two|https docs dagster io integrations dbt using dbt with dagster part two>

Mike Needham · Answer

yes that is what I followed the instructions do not address the error the code above is the snippet from the tutorial all things are installed as far as I can tell

rex · Answer

You are doing `from myproject dagster import load assets from dbt project` The tutorial says `from dagster dbt import load assets from dbt project`

Mike Needham · Answer

thank you I missed that when trying something else

Mike Needham · Answer

so i ripped everything out re downloaded the dbt example and am trying to point to my existing dbt project in a different directory I cannot seem to get the relative path to work it either complains about not being to find the profile name of the project or it says invalid project directory not dbt project yml

Mike Needham · Answer

it must be something simple but have tried various levels of with no success

rex · Answer

it should be the file path relative to the current file you re working in You can debug if the file path is correct by printing out the file path locally

Mike Needham · Answer

I have the path but then it complains about the dbt project yml not sure what else to do as the DBT project is fine and runs correctly

Mike Needham · Answer

so i think i have the correct path now but am geting 2022 12 07 14 45 28 0600 dagster builtin ERROR Encountered an error while reading the project 2022 12 07 14 45 28 0600 dagster builtin ERROR ERROR Runtime Error Could not find profile named PM3 Loaders 2022 12 07 14 45 28 0600 dagster builtin ERROR Encountered an error Runtime Error Could not run dbt

Mike Needham · Answer

that is the DBT project and is in the dbt project yml as the name

rex · Answer

You re running into dbt errors now not Dagster errors You should make sure that your dbt project is well formed <https docs getdbt com guides legacy debugging errors could not find profile>

Mike Needham · Answer

it is I can run it with no errors

Mike Needham · Answer

it is when I try and combine the two that it does not work I have one vscode session with the dbt project open and one with the dagster project

rex · Answer

Again it looks like your profiles variable is wrong This is usually hosted in the ` config` directory of your project From what you posted above `DBT PROFILES = file relative path file dbt project project1 ` This should probably be `DBT PROFILES = file relative path file dbt project project1 config ` The guide is here <https docs dagster io integrations dbt using dbt with dagster part two step 1 load the dbt models as assets>

Mike Needham · Answer

I do not have them in a config directory the dbt template put the dbt project yml in the root of the project

rex · Answer

where did you put your `profiles yml`

Mike Needham · Answer

whatever the default is looks like dbt

rex · Answer

then use `DBT PROFILES = file relative path file dbt project project1 dbt `

Mike Needham · Answer

that was it I am an idiot thank you for your help

Mike Needham · Answer

still trying to get a proof of concept going with this to try and sell my team on this approach