Gabe Schine02/03/2023, 7:36 PM
is materialized at least every hour, either through reconciliation with upstream, or through some other mechanism. What is the best mechanism to use?
is not right, nor is an
Sean Lopp02/03/2023, 8:28 PM
Gabe Schine02/03/2023, 9:22 PM
A -> B
is downstream of
is materialized every 24h even if
is not, because the upstream data hasn't changed.
still shows as late because its upstream dependency is older than 24h
sandy02/03/2023, 10:46 PM
doesn't change, why do you want
depend on other data that does change?
Gabe Schine02/03/2023, 10:49 PM
is a calendar-week filtered view of
, so as time passes
will change without the upstream source data changing
sandy02/03/2023, 10:53 PM