Mikael Frosthage
03/13/2024, 9:04 AMScout
03/13/2024, 9:04 AMend_offset
parameter when defining your partitions. The end_offset
parameter allows you to extend the partition set by a number of partitions equal to the value passed. If end_offset
is set to 0 (the default), the last partition ends before the current time. By setting end_offset
to 1, you can create a partition for the current day. Here's an example of how you might define a daily partition with an end_offset
to include the current day: python from dagster import DailyPartitionsDefinition daily_partitions_def = DailyPartitionsDefinition( start_date="2021-01-01", end_offset=1, # This allows there to be a partition for the current day )
In this example, the DailyPartitionsDefinition
is used to create daily partitions starting from a specific date, and the end_offset=1
ensures that there is a partition for the current day. If you are trying to use hour_offset
and it's not working as expected, it's important to ensure that you are using the correct partition definition and that the hour_offset
is being applied in the right context. The hour_offset
is typically used with time-based partition definitions like HourlyPartitionsDefinition
or TimeWindowPartitionsDefinition
. If you continue to face issues, please provide more details about your current setup, including the code you're using to define your partitions and how you're attempting to use hour_offset
. This will help us give you more specific guidance.