https://dagster.io/ logo
Join Slack
Powered by
First time user here: having trouble getting the ...
# integration-dbt
c
First time user here: having trouble getting the tutorial (jaffle_shop) to work. This is what i have currently done and the issues i have encountered. windows machine. created a venv (python 3.9.0) there is not step in the tutorial for pip installing dbt-duckdb (but that appears to be required) i'm also getting errors that no module called dagster_dbt is found. When I pip install that library I enter into dependency hell. any one have any hints on how to get this to work? current documentation i'm using is 1.4.4/0.20.4 (libs)
r
The missing 
dbt-duckdb
dependency was an oversight, and was addressed this week: https://github.com/dagster-io/dagster/pull/15717. The docs should be updated after this week’s release.
When I pip install that library I enter into dependency hell.
Do you have logs of what is happening? What version of 
pip
are you using? Have you tried upgrading 
pip
?
c
so Pip was up to date (pip 23.2.1)
i'm repeating the tutorial now and will provide you with dependancy issues
the first error that occurs is after calling 
dbt build
as per the documentation.
Copy code
18:51:48  Running with dbt=1.6.0
18:51:48  Encountered an error:
No module named 'dagster_dbt'
after 
pip install dagster-dbt
i arrive at my first dependency issue.
Copy code
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
dbt-duckdb 1.6.0 requires dbt-core~=1.6.0, but you have dbt-core 1.5.4 which is incompatible.
i'll try to resolve this with 
pip install --upgrade dbt-core==1.6.0
i get this then
Copy code
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
dagster-dbt 0.20.4 requires dbt-core<1.6, but you have dbt-core 1.6.0 which is incompatible.
r
Very confused here: are you running this in your virtualenv?
185148 Running with dbt=1.6.0
but you have dbt-core 1.5.4
c
yes
r
dbt-core==1.6
was released last week, and we just recently supported it: https://github.com/dagster-io/dagster/pull/15663. This change will be released in 
dagster-dbt==0.20.5
, which is not out yet. It will be released later today. I recommend that you install 
dbt-core==1.5.x
and 
dbt-duckdb==1.5.x
in the meantime.
c
nice i did the following: 
pip install --upgrade dbt-duckdb==1.5.4
pip install --upgrade dbt-core==1.5.4
was able to get the command 
dbt build
to work successfully.
r
awesome
c
sadly the next part of the tutorial broke
the first step of the next sequence of the tutorial asks that you install 
pip install dagster dagster-webserver dagster-dbt
which as far as i can tell is not necessary because i was forced to install dagster-dbt in the previous part (i think dagster-dbt also install dagster and dagster-webserver)
current module version for dagster:
Copy code
dagster==1.4.4
dagster-dbt==0.20.4
dagster-graphql==1.4.4
dagster-webserver==1.4.4
as per the documentation i run 
dagster-dbt project scaffold --project-name jaffle_dagster
and get this error
Copy code
TemplateNotFound: scaffold\definitions.py.jinja
r
Sorry for the thrash here: looks like we fixed our docs for this tutorial back last week, but we have redeployed yet for our weekly release:
the first step of the next sequence of the tutorial asks that you install 
pip install dagster dagster-webserver dagster-dbt
• This is addressed here: https://github.com/dagster-io/dagster/pull/15705
TemplateNotFound: scaffold\definitions.py.jinja
• This is a windows specific issue, and other users have already reported this. Will be addressed in this week’s release https://github.com/dagster-io/dagster/pull/15748
c
ah sorry i did not see these. Thanks Rex you the man!!
make sense since that jinja file is definitely there
106 Views
Open in Slack
PreviousNext
Powered by