Lorenzo
08/17/2022, 8:35 AMVinnie
08/17/2022, 8:50 AMwith open('manifest.json') as f:
load_assets_from_dbt_manifest(f)
why not load with load_assets_from_dbt_project
though?Lorenzo
08/17/2022, 8:57 AMdbt_assets_1 = load_assets_from_dbt_project(project_dir=DBT_PROJECT_DIR, select="first_dbt")
dbt_assets_2 = load_assets_from_dbt_project(project_dir=DBT_PROJECT_DIR, select="second_dbt")
dbt_assets_3 = load_assets_from_dbt_project(project_dir=DBT_PROJECT_DIR, select="third_dbt")
dbt_assets_4 = load_assets_from_dbt_project(project_dir=DBT_PROJECT_DIR, select="fourth_dbt")
In this way I can select only one model in the dag and run it singularly, but the downside is that I need to define each asset.Vinnie
08/17/2022, 9:51 AM[define_asset_job(asset) for asset in loaded_assets]
(obviously untested, probably need a few more parameters)sandy
08/17/2022, 5:30 PMload_assets_from_dbt_manifest
shouldn't expect a file object. mind sharing the full stack trace?