Is there a dagster pattern that can utilize an asset to populate a DynamicPartition? I have a working sensor implementation that is fine, but I thought I would ask if there is a way to change from a "push" sensor approach to a "pull" freshness-policy/AutoMaterialization approach. The idea is to have a "child" partition trigger an upstream materialization (read a csv file), fill a dynamic partition, and then materialize the partitions that are missing.
🤖 1
j
jamie
09/05/2023, 8:09 PM
hey @Sean Davis i haven’t tested this, but you might be able to add the partitions this way