Wonjae Lee
02/15/2024, 5:14 PMScout
02/15/2024, 5:14 PMAddDynamicPartitionsRequest
and DeleteDynamicPartitionsRequest
which can be evaluated by a sensor or schedule to manage dynamic partitions. However, there is a discussion in the community about the possibility of utilizing dynamic partitioning without relying on sensors or schedules, specifically through the use of execute_in_process
. The documentation does not explicitly state a method for updating dynamic partitions before a run without using sensors or schedules, and the conversation suggests that this is an area of ongoing development and exploration within the Dagster community. Therefore, while the typical approach involves sensors or schedules, if you are looking for alternative methods to manage dynamic partitions, it may be worth exploring community discussions or reaching out to the Dagster team for more current or upcoming features that might address this use case.