Averell08/16/2022, 7:27 AM
Option 2: Or should I define a custom schema run_config with a Start_date, in which I can create a custom run with the start_date set to be 2 years ago? With option 2, could you please point me to the document for that run_config? Option 3: (the best I think) is to have something similar to
daily_partitions = DailyPartitionsDefinition(start_date=datetime(2022, 08, 15)) @asset(partitions_def=daily_partitions,) def my_asset(context): start_date, end_date = context.output_asset_partitions_time_window() if start_date == daily_partitions.GET_FIRST_PARTITION: start_date = TWO_YEARS_AGO ....
having one ops that produce multiple partitions. I'm not sure whether something similar to this exists. Thanks!
Stephen Bailey08/16/2022, 4:42 PM
sandy08/16/2022, 7:53 PM
Averell08/18/2022, 12:59 PM