Giovanni Paolo
07/14/2023, 5:42 PMGiovanni Paolo
07/14/2023, 5:45 PMGiovanni Paolo
07/14/2023, 5:54 PMGiovanni Paolo
07/14/2023, 5:55 PMowen
07/14/2023, 6:17 PMTimeWindowPartitionsDefinition(
start_date=...,
schedule_type=ScheduleType.WEEKLY,
day_offset=3,
fmt="%Y-%m-%d",
)
This would let you have your weekly partitions be shifted by 3 days, so they'd only pop into existence when they actually existed.
The downside of this is that your partitions will be mislabeled (as they'll represent the time they came into existence rather than the data they actually contain)Giovanni Paolo
07/14/2023, 6:44 PMTimeWindow(start=DateTime(2023, 7, 5, 0, 0, 0, tzinfo=Timezone('UTC')), end=DateTime(2023, 7, 12, 0, 0, 0, tzinfo=Timezone('UTC')))
Giovanni Paolo
07/14/2023, 6:46 PMGiovanni Paolo
07/14/2023, 6:50 PMGiovanni Paolo
07/14/2023, 6:50 PM