How can I work with partitioned software defined assets In a

Question

How can I work with partitioned software defined assets In a graph which combines `op` and `asset` Right now I get a `DagsterInvalidConfigError Error in config for job` `Error 1 Missing required config entry dummy asset partitioned at path root ops Sample config for missing entry dummy asset partitioned config date ` as Dagster is feedng the configuration per op and somehow is only filling the partition date into a single of the two steps

geoHeil · Answer

when forming a partitioned schchedule ``` daily partitioned config start date=datetime 2022 2 1 def my partitioned config start datetime end datetime return ops my op config date start strftime Y m d ``` Is it somehow possible to feed the partition globally And not for each operation which is part of the graph materializing the asset

geoHeil · Answer

I guess it would be the same problem when working with many software defined assets as well assuming they are partitioned

sandy · Answer

You shouldn t need to use the `daily partitioned config` decorator for software defined assets Instead you attach a `DailyPartitionsDefinition` to each asset Inside the asset s compute function you can directly access the partition from the context E g ``` asset partitions def=DailyPartitionsDefinition start date= 2020 04 04 def my asset context partition key = context output asset partition key alternatively start dt end dt = context output asset partitions time window ```

geoHeil · Answer

interesting Can I share the `DailyPartitionsDefinition` and `daily partitioned config` when mixing ops and assets in a graph

sandy · Answer

we don t currently have a straightforward way to mix ops and assets within a graph though we plan to add one if that s a blocker for you I might be able to help you figure something out

geoHeil · Answer

no this is fine for now knowing it is a limitation