Gaurav Gurjar
03/03/2024, 2:30 PMfrom dagster import WeeklyPartitionsDefinition
from ..assets import constants
start_date = constants.START_DATE
end_date = constants.END_DATE
weekly_partition = WeeklyPartitionsDefinition(
start_date=start_date,
end_date=end_date
)
Tim Castillo
03/03/2024, 5:34 PMTimeWindowPartitionsDefinition
class in Dagster. There, you can define a cron schedule that will define a new partition every year. For example:
from dagster import TimeWindowPartitionsDefinition
from ..assets import constants
start_date = constants.START_DATE
end_date = constants.END_DATE
yearly_partition = TimeWindowPartitionsDefinition(
cron_schedule="0 0 1 1 *",
start_date=start_date,
end_date=end_date
)