https://dagster.io/ logo
#ask-community
Title
# ask-community
b

Ben Kimpel

06/06/2023, 6:58 PM
hello, i could use some help with schedules and sensors. i have daily partitioned assets whose source files drop to S3 anywhere (let's just say) from 4pm to midnight M-F,Su. is this a situation for a sensor or a schedule or both? my daily partition definition for each is just DailyPartitionsDefinition(start_date="some_start_date_for_dataset")
d

Daniel Vetter

06/06/2023, 7:17 PM
this sounds like a job for a sensor maybe with a dynamically partitioned asset instead of a daily partitioned asset - https://docs.dagster.io/_apidocs/partitions#dagster.DynamicPartitionsDefinition
👀 1
b

Ben Kimpel

06/06/2023, 7:23 PM
thanks, i'll look into that. haven't looked at dynamic partitions yet.
d

Daniel Vetter

06/06/2023, 7:23 PM
i really like them, though perhaps I overuse them lol