Riccardo Tesselli
06/01/2023, 11:58 AMRiccardo Tesselli
06/01/2023, 12:04 PMDbtManifestAssetSelection
which takes all the dbt models that I want to run. All these models have to run before a downstream asset A
can run. I’ve put this asset selection as non_argument_deps
for my downstream asset A
, but then my dag gets overly complicated because there is a direct link between ALL my dbt models to A
, so ideally I just want to simplify the dag by creating a dependency between the leaves of the dag given from dbt to my asset A
Riccardo Tesselli
06/01/2023, 12:06 PMA -> B -> C
| | |
v v v
Z Z Z
but I would like to get A->B->C->Z
Riccardo Tesselli
06/01/2023, 1:29 PMclaire
06/01/2023, 5:07 PMAssetSelection.keys(...).sinks()
The sinks
function searches within the existing asset selection and returns all assets that do not have any downstream dependencies within the existing selection.