Ivan Doroshenko
06/08/2022, 2:40 PMSourceAsset
? We are using Databricks and Delta Lake engine so we do not need actual IO Managers for assets materializations but want to maintain declarative assets catalog with dependencies. Is there way to just declare assets definitions and dependencies between them, but all actual materializations will be handled by jobs (and not @assets
methods) spawning materializations events upon completion.Samuel Stütz
06/08/2022, 3:19 PM@op(
ins={"...": In(asset_key=AssetKey(["..", ".."]))},
out=Out(io_manager_key="...", asset_key=AssetKey(["..", ".."])),
)
This works mostly without @asset . You can still see that there will be an asset but the graph and most info only appear after a run. Also materialize does not work.
I don’t think it works for Dynamic outputs.sandy
06/16/2022, 8:38 PMsandy
06/29/2022, 4:59 PM