Hello, want to check if I am misunderstanding, or seeing a bug. My understanding is auto-materialization only works on latest partition, i.e. it never tries to backfill for us. Given •

weather_data_df

has the latest partition materialized •

latest_weather_data_df

is set to eager •

latest_weather_data_df

has never been materialized before I expect

Materialization is missing

to be checked. Though that is not the case after 29 evaluations. I suspect this is due to usage of

LastPartitionMapping

to clear the partition. For completeness, the previous 2 skips were due to

Waiting on upstream data

you can set

max_materializations_per_minute

to a higher value to achieve the backfill effect

Thanks Daniel, I tried backfilling the first partition of

weather_data

, but I wasn’t able to get the

weather_data_df

to trigger any Materialization condition. Given •

weather_data

’s first partition is there • `weather_data_df`’s first partition has not materialized before • I waited for the

Evaluation History

count to increment I expect

Materialization is missing

to be true, but that is not the case.