Alex Molotsky
04/14/2022, 12:58 PMresult = execute_pipeline(
my_reconstructable_job,
run_config={"execution": {"config": {"multiprocess": {}}},
instance=DagsterInstance.local_temp(),
)
without the run_config param, my job is executing in a single process, but with the current run config. I'm getting InvalidConfigError:
E dagster.core.errors.DagsterInvalidConfigError: Error in config mapping
E Error 1: Received unexpected config entry "multiprocess" at path root:execution:config. Expected: "{ marker_to_close?: String retries?: { disabled?: { } enabled?: { } } }".
venv/lib/python3.9/site-packages/dagster/core/definitions/config.py:84: DagsterInvalidConfigError
What is the correct run_config for multiprocess mode?
(I'm running dagster 0.14.6)alex
04/14/2022, 2:12 PMexecutor_def
on your job
at all?alex
04/14/2022, 2:12 PMin_process_executor
set on the definitionAlex Molotsky
04/14/2022, 3:10 PMAlex Molotsky
04/14/2022, 3:11 PMalex
04/14/2022, 3:12 PM