We have a scheduled job that runs daily partitions...
# ask-community
a
We have a scheduled job that runs daily partitions. Part of the job checks the date of UTC now against the partition key. These appear to not match. The jobs schedule is set for 1 PM UTC time. How is dagster determining the partition key date string and is there a way to make sure it is using UTC time zone?
Think I answered my own question. It's only going to try to fill the partition after the partition time period is complete. So for our slightly unusual use case, we need to compare key against previous day.
o
yep this is correct -- just as a side note, if you would prefer to offset the partition keys by a day, you can use the
end_offset
parameter of
DailyPartitionsDefinition
.
a
Interesting. I'm not sure where I like the offset to exist (e.g. what would be easiest for someone who hasn't seen it before to understand what is going on).