https://dagster.io/ logo
Join Slack
Powered by
I have configured a start date for a sensor for 2...
# ask-community
g
I have configured a start date for a sensor for 2022-07-28 (today) but dagit maximally allows to select dates until 2022-07-27. How can I tell/allow dagit a partition for today? And not only yesterday.
A schedule would allow to specify `
Copy code
execution_timezone
` https://docs.dagster.io/concepts/partitions-schedules-sensors/schedules#timezones but for the partitions of a sensor I cannot find a smimilar function
DailyPartitionsDefinition
which is backing the sensor indeed does offer some time zone related settings
However, 
daily_partitions_def = DailyPartitionsDefinition(start_date="2022-07-25", timezone="Europe/Vienna")
only renders the 25th, 26th and 27th not today (28th) in the partition handling of dagster/dagit
a
Partitions only show partitions that have completed - so the 28th will show up after midnight (pretty sure on this, but not 100%)
g
But if I have a job which needs to ingest the data of today into the partition of today as the data is delivered today: 01:00 early in the morning but should be used today0900 when business opens? How can I get a partition to be available earlier?
s
hey geoHeil - for the partition that you want to be named "2022-07-26", what is the time window of data that you want to be included in that partition?
g
2022-07-26 000000 until 2022-07-26 235959
s
got it - if you set 
end_offset=1
, on your 
PartitionsDefinition
, then your partitions should include "2022-07-26" as soon as the clock strikes 2022-07-26 000000
🌈 1
❤️ 1
D 1
g
confirmed. Great many thanks!
s
awesome
Open in Slack
PreviousNext
Powered by