Gabriel Montañola
04/05/2022, 11:22 PMdbt
assets using load_assets_from_dbt_project in the same repository we get an error like this.
I suspected the culprit is here. The Op/Solid is always called dbt_project
and so it collides.
🧪 Our use case (because we maybe are doing things the wrong way).
We have a single dbt_project and we are creating basic pipelines with airbyte -> dbt assets.
But since we want to select different models for each job we use the select
parameter to do this.
on one job
dbt_assets_from_somewhere = load_assets_from_dbt_project(
project_dir=DBT_PROJECT_DIR,
profiles_dir=DBT_PROJECT_DIR + "/profile",
select="tag:really_cool_stuff"
)
and on another
dbt_assets_and_such = load_assets_from_dbt_project(
project_dir=DBT_PROJECT_DIR,
profiles_dir=DBT_PROJECT_DIR + "/profile",
select="tag:tags_are_fun,tag:really_fun"
)
Breaking this into repositories fixes the issue but this jobs are pretty similar in scope. Please let me know if I can provide any relevant input to help :)prha
04/05/2022, 11:37 PMowen
04/05/2022, 11:41 PMGabriel Montañola
04/05/2022, 11:47 PMowen
04/06/2022, 12:16 AMGabriel Montañola
04/08/2022, 4:29 PM