Hi All I want to integrate dagster dbt and I use `load asset

Question

Hi All I want to integrate dagster dbt and I use `load assets from dbt project ` but Asset is not found it is not showing up in the console where in my local I can see the lineage dagster version = 0 15 8 deployment in ubuntu compute engine VM GCP

Fanny Wiryana · Answer

```dagster repo + dbt repository py dbt + config + dbt project yml + profile yml + model + macros``` in dbt repository py the code looks like this point down ```DBT PROJECT DIR = ROOT DIR dbt config DBT PROFILES DIR = ROOT DIR dbt config dbt assets = load assets from dbt project DBT PROJECT DIR profiles dir=DBT PROFILES DIR use build command=True select= ```

yuhan · Answer

hey Fanny where exactly did you mean by the console

Fanny Wiryana · Answer

in the UI I mean

yuhan · Answer

what s in your `repository` definition did you include `dbt assets` in it or did you use things like `load assets from package module` to load the entire module package

Fanny Wiryana · Answer

I only use `load asset from dbt project` and ```data a = define asset job data a selection=AssetSelection keys AssetKey data a data a ``` call the asset like this point up

Fanny Wiryana · Answer

then ``` repository def transformation layer return with resources dbt assets resource defs= dbt dbt cli resource configured project dir DBT PROJECT DIR profiles dir DBT PROFILES DIR ```

yuhan · Answer

in your dbt assets ```dbt assets = load assets from dbt project DBT PROJECT DIR profiles dir=DBT PROFILES DIR use build command=True select= ``` you had ```select= ``` was it intentional to select ` ` as opposed to ` `

Fanny Wiryana · Answer

I remember copy it from somewhere but previously I tried ```dbt assets = load assets from dbt project DBT PROJECT DIR profiles dir=DBT PROFILES DIR ``` also not working

yuhan · Answer

```DBT PROJECT DIR = ROOT DIR dbt config ``` should be ```DBT PROJECT DIR = ROOT DIR dbt ```

Fanny Wiryana · Answer

now I got this error ```dagster dbt errors DagsterDbtCliFatalRuntimeError Fatal error in the dbt CLI return code 2 File home ubuntu local lib python3 8 site packages dagster grpc server py line 227 in init self loaded repositories = LoadedRepositories File home ubuntu local lib python3 8 site packages dagster grpc server py line 101 in init loadable targets = get loadable targets File home ubuntu local lib python3 8 site packages dagster grpc utils py line 33 in get loadable targets else loadable targets from python file python file working directory File home ubuntu local lib python3 8 site packages dagster core workspace autodiscovery py line 26 in loadable targets from python file loaded module = load python file python file working directory File home ubuntu local lib python3 8 site packages dagster core code pointer py line 86 in load python file return import module from path module name python file File home ubuntu local lib python3 8 site packages dagster seven init py line 51 in import module from path spec loader exec module module File lt frozen importlib bootstrap external gt line 848 in exec module File lt frozen importlib bootstrap gt line 219 in call with frames removed File opt dagster repo sync data engineering dbt repository py line 20 in lt module gt dbt assets = load assets from dbt project File home ubuntu local lib python3 8 site packages dagster dbt asset defs py line 424 in load assets from dbt project manifest json cli output = load manifest for project File home ubuntu local lib python3 8 site packages dagster dbt asset defs py line 41 in load manifest for project cli output = execute cli File home ubuntu local lib python3 8 site packages dagster dbt cli utils py line 139 in execute cli raise DagsterDbtCliFatalRuntimeError ```

yuhan · Answer

the error usually means the path to the dbt project isn t correctly set here s how we load the dbt project into assets where is similar to yours

Fanny Wiryana · Answer

just tried to follow the code ```DBT PROJECT DIR = file relative path file dbt config DBT PROFILES DIR = file relative path file dbt config ``` but still did not work no Asset loaded to the repository do u think its because of version I use 0 15 8

yuhan · Answer

could you try with ```DBT PROJECT DIR = file relative path file dbt this should point to the dbt project folder not the config folder DBT PROFILES DIR = file relative path file dbt config ```

Fanny Wiryana · Answer

got this error again ```dagster dbt errors DagsterDbtCliFatalRuntimeError Fatal error in the dbt CLI return code 2 ```

yuhan · Answer

cc < owen> does the error ring any bell

owen · Answer

hi < Fanny Wiryana> sorry you re running into this In a more recent update to the dagster dbt library we made it so that a more descriptive error message would be shown when you encountered this error which would definitely help tracking down the exact cause here There s all sorts of potential issues that might cause this for example if the connector library like dbt postgres or dbt postgres is not installed on the machine that s running the code If it s easy for you to do then upgrading to the newest version of dagster dbt might be a good option regardless of your dagster dbt version this more descriptive error message also gets displayed in the terminal that dagit is running in it sounds like you re running your dagster deployment on a remote machine so it might not be easy to access these logs but if you re able to this would also be a good thing to check You can also try running dagit on your local machine `dagit f path to dbt repository py` to view the logs there