Robert Kolb
04/17/2023, 6:40 PMDynamicPartitionsDefinition
. The downstream asset is also using dynamic partitions.
When executing the downstream asset after confirming that the upstream asset has run and all partitions are populated, I get the following error:
dagster._core.errors.DagsterInvalidInvocationError: Partition range wicked_folder/basic_csv4.csv to wicked_folder/basic_csv1.csv is
not a valid range. Nonexistent partition keys:
['wicked_folder/basic_csv4.csv', 'wicked_folder/basic_csv1.csv']
In the screenshot attached to this reply you can see that the partitions have run in the upstream node.
The odd thing is that if I opt to run a backfill on only 1 partition, then the asset is materialized as I would expect.
screenshots in the replyclaire
04/18/2023, 5:08 PM