https://dagster.io/ logo
c

Chris Roth

05/05/2023, 7:30 AM
I have created a scheduled op that dynamically adds partitions to a
DynamicPartitionsDefinition
If I want to have the assets that are partitioned along this dynamic partition set materialize, I set the materialization policy to eager and this works. But, if I want to add the ability to have config parameters that are determined by the scheduled op above passed to the asset, how would I do this?
Is there a way to save the partitioned config in the op so that it will be used when the asset materializes?
c

chris

05/05/2023, 3:53 PM
https://github.com/dagster-io/dagster/discussions/13958 currently not possible unfortunately - definitely something on the radar though
c

Chris Roth

05/05/2023, 4:04 PM
As a work around for the time being, I figured out a way to run an asset materialization within the op that passes a run_config. But it doesn't make for pretty results in the dagit dashboard.
2 Views