Hi, I'm using Dagster & DBT. For DBT we are m...
# integration-dbt
i
Hi, I'm using Dagster & DBT. For DBT we are materializing to postgres database using the dbt-postgres adaptor. There is no support for partitioning in dbt with this adaptor. I just wanted to confirm if that therefore meant that the partitioning functionality in Dagster is out of question for my project?
s
Hi Ian - you can implement partitioning on your own by using dbt vars. Take a look at the discussion here: https://github.com/dagster-io/dagster/issues/7683.
👍🏿 1
i
Hi Sandy, One thing that is not clear to me from reading the doco you have shared. Will this still work even if my postgres underlying tables in postgres are not setup with subpartitions? It's not obvious to me how Dagster is able to achieve this. I'm quite new to Dagster so this may be a dumb question.
s
Yes it will still work - Dagster partitions will basically just correspond to sets of records that match some
where
clause, usually that the fell into a particular time range. It's up to you to use dbt vars to put that
where
clause in your queries
👍🏿 1