Rasmus Hallén08/26/2022, 10:43 AM
Szymon Zaborowski08/26/2022, 11:35 AM
sandy08/26/2022, 2:59 PM
but do not rematerialize it if the first job succeeded (and fail if it failed)are you able to clarify what you mean by this a little further? let's say the big asset is rematerialized at 1 am and succeeds at 1:10. are you saying that you wouldn't want to materialize the small asset at 1:15?
Rasmus Hallén08/30/2022, 6:39 AM
Then only use the small_asset in the asset job. @Szymon Zaborowski you mean that I make my small_asset a partitioned asset? And I wouldnt have to use a custom IOManager to store only the latest partition on disk?
@asset big_asset(): return @asset small_asset(big_asset): assert latest_materialization_of_big_asset_succeded() return