What would be the best possible way to schedule a daily partitioned asset to run on a T+1 basis, Airflow had a

TimeDeltaSensor

that you can set to wait for a number of hours.

you can use the

hour_offset

parameter of

DailyPartitionsDefinition

to do this https://docs.dagster.io/_apidocs/partitions#dagster.DailyPartitionsDefinition

I tried setting the

hour_offset

to a number greater than 24 and I get the following error in the UI

Operation name: LaunchAssetLoaderQuery

Message: [30 27 * * *] is not acceptable, out of range

Path: ["assetNodes",7,"partitionDefinition"]

Locations: [{"line":31,"column":3}]

This is my partition

DailyPartitionsDefinition(start_date="2023-01-12",  
						  fmt='%Y-%m-%d',
						  timezone='America/New_York', 
						  minute_offset=30,
						  hour_offset=27)

Ah I see, I think i misread the original question. Originally I thought you wanted the partition to be offset (ie 2/3/23 1:00 to 2/4/23 1:00), but you just want to ensure that the schedule materializes a partition only after the day is complete? is that correct?

Correct, it's for cases where data is known to arrive late

ok cool - in that case i think the schedule should already be setup to only run for “completed” partitions (ie when the end of the partition is in the past) it’s described here below the two code snippets. This in particular

You can use the

minute_of_hour

,

hour_of_day

,

day_of_week

, and

day_of_month

parameters of

build_schedule_from_partitioned_job

to control the timing of the schedule. For example, if you have a job that’s partitioned by date, and you set

minute_of_hour

to

30

and

hour_of_day

to

1

, the schedule would submit the run for partition

2020-04-01

at 1:30 AM on

2020-04-02

.

Thanks I'll try it out