Spencer Nelson
02/08/2023, 5:45 PMAssetDefinition.from_op
. So if I have a Job from define_asset_job
, I can reuse my Ops
But can I go the other direction? Can I use assets in a non-asset Job? Can I build a Graph
out of a pile of Assets?Ansel Boero
02/08/2023, 11:23 PMdefine_asset_job
function?
Alternatively, what is the best approach to include an op at the end of a job that materializes multiple assets?Rasmus Bonnevie
02/09/2023, 11:11 AMDefinitions
, but since the jobs have to be defined prior to the definition object, the jobs are in a sense more limited than the scripts?Spencer Nelson
02/09/2023, 5:51 PMsean
02/10/2023, 4:08 PMBut can I go the other direction? Can I use assets in a non-asset Job?You can do whatever you want materialize a non-SDA asset inside an op and represent that with
context.log_event(AssetMaterialization(asset_key="foo"))
Can I build a Graph out of a pile of Assets?No, dagster graphs (i.e.
GraphDefinition
, @graph
) are built out of ops, but multiple @asset
from an implicit graph via references between asset keys.
That said, we’re well aware our docs are weak here and we are working to address it-- a new guide will be up soon: https://github.com/dagster-io/dagster/pull/12204Roel Hogervorst
03/10/2023, 3:40 PM