Danny Steffy
04/14/2023, 7:06 PMbuild_asset_reconciliation_sensor
where we select an asset group. For some reason the created __ASSET___JOB
looks like it's all assets, including downstream assets in a different group. Is this expected behavior? I was under the impression the job would only be for all downstream assets in the groupclaire
04/14/2023, 7:12 PMAssetSelection.groups(...).downstream()
? The downstream
method will select downstream assets that are outside of the existing selection.
You could do something like this instead:
AssetSelection.groups(...).downstream() & AssetSelection.groups(...)
Danny Steffy
04/14/2023, 7:21 PMbuild_asset_reconciliation_sensor(
name="update_training_model_assets_sensor",
asset_selection=AssetSelection.groups("training_model"),
),
Danny Steffy
04/14/2023, 7:22 PMclaire
04/14/2023, 9:52 PMDefinitions
object without defining a job containing those assets. Similarly, these internal jobs enable you to select and kick off materializations via Dagit without having a job defined.
The reconciliation sensor is referencing the internal job, to which it'll apply the asset selection provided to the reconciliation sensor. So I think you'll still get the behavior that you expect, I think it's probably just a little bit weird of a UI experience.