Daniel Chalef
02/14/2023, 10:36 PMexecute_k8s_job
. The op is called via map
of a `DynamicOutput`list. execute_k8s_job
uses the name from the OpExecutionContext
as the k8s job name. However, it doesn’t appear that the op’s name is actually unique for each invocation of the op in the map operation, which results in dagster attempting to create k8s jobs with duplicate names.
I’ve considered using a factory that generates ops with unique names, but am unsure how I’d use this with map
.
How do I ensure that each mapped invocation of an op has a unique name?owen
02/14/2023, 10:50 PMexecute_k8s_job
op is downstream of a dynamic output. This fix should make it out in this week's 1.1.19 releaseDaniel Chalef
02/14/2023, 10:53 PMowen
02/14/2023, 10:55 PMDaniel Chalef
02/14/2023, 10:56 PMDaniel Chalef
02/14/2023, 11:04 PMowen
02/14/2023, 11:04 PM