Hello, I have a requirement where I have to run a ...
# ask-community
v
Hello, I have a requirement where I have to run a data pipeline for a set of keys. I figured out that I have to use
static_partitioned_config
or
dynamic_partitioned_config
, but currently the
_run_config_wrapper
for these decorators only accepts partition_key as input. Is there a way to access
config_mapping
params in this function, so we can add other config values in
run_config_for_partition_fn
in addition to partition_key. If this is not possible, what is the best way to set up the job. Thanks,
s
Hi @Vrushank Kenkre - currently, if you