Is it currently possible to have a multi dimensional dynamic_partitioned_config? The use case here is that we have daily batch jobs that run per customer, but we also want to support back filling by day. New customers are added all the time, which is the need for the dynamic_partitioned_config. Not sure how to get this setup with Dagster and we are currently migrating from Airflow.
01/10/2023, 9:16 PM
A potential issue here is that dynamic_partitioned_config currently doesn't work with software-defined assets, and I believe multi-dimensional partitions only work with software-defined assets.
@claire - am I right about the latter?
It's currently on our near-term roadmap to support dynamic partitions with assets: https://github.com/dagster-io/dagster/issues/7943
01/10/2023, 9:41 PM
Yes, multi-dimensional partitions currently only work with software defined assets