I have configured a start date for a sensor for 2022 07 28 t

Question

I have configured a start date for a sensor for 2022 07 28 today but dagit maximally allows to select dates until 2022 07 27 How can I tell allow dagit a partition for today And not only yesterday

geoHeil · Answer

A schedule would allow to specify ` ```execution timezone``` ` <https docs dagster io concepts partitions schedules sensors schedules timezones> but for the partitions of a sensor I cannot find a smimilar function

geoHeil · Answer

`DailyPartitionsDefinition` which is backing the sensor indeed does offer some time zone related settings

geoHeil · Answer

However `daily partitions def = DailyPartitionsDefinition start date= 2022 07 25 timezone= Europe Vienna ` only renders the 25th 26th and 27th not today 28th in the partition handling of dagster dagit

Adam Bloom · Answer

Partitions only show partitions that have completed so the 28th will show up after midnight pretty sure on this but not 100

geoHeil · Answer

But if I have a job which needs to ingest the data of today into the partition of today as the data is delivered today 01 00 early in the morning but should be used today 09 00 when business opens How can I get a partition to be available earlier

sandy · Answer

hey geoHeil for the partition that you want to be named 2022 07 26 what is the time window of data that you want to be included in that partition

geoHeil · Answer

2022 07 26 00 00 00 until 2022 07 26 23 59 59

sandy · Answer

got it if you set `end offset=1` on your `PartitionsDefinition` then your partitions should include 2022 07 26 as soon as the clock strikes 2022 07 26 00 00 00

geoHeil · Answer

confirmed Great many thanks

sandy · Answer

awesome