Rasmus Hallén
08/26/2022, 10:43 AMSzymon Zaborowski
08/26/2022, 11:35 AMsandy
08/26/2022, 2:59 PMbut do not rematerialize it if the first job succeeded (and fail if it failed)are you able to clarify what you mean by this a little further? let's say the big asset is rematerialized at 1 am and succeeds at 1:10. are you saying that you wouldn't want to materialize the small asset at 1:15?
Rasmus Hallén
08/30/2022, 6:39 AM@asset
big_asset():
return
@asset
small_asset(big_asset):
assert latest_materialization_of_big_asset_succeded()
return
Then only use the small_asset in the asset job.
@Szymon Zaborowski you mean that I make my small_asset a partitioned asset? And I wouldnt have to use a custom IOManager to store only the latest partition on disk?