Hello. I'm trying to run my job in a multiprocess ...
# ask-community
a
Hello. I'm trying to run my job in a multiprocess mode for unit tests. I'm executing the following code
Copy code
result = execute_pipeline(
        my_reconstructable_job,
        run_config={"execution": {"config": {"multiprocess": {}}},
        instance=DagsterInstance.local_temp(),
    )
without the run_config param, my job is executing in a single process, but with the current run config. I'm getting InvalidConfigError:
Copy code
E           dagster.core.errors.DagsterInvalidConfigError: Error in config mapping 
E               Error 1: Received unexpected config entry "multiprocess" at path root:execution:config. Expected: "{ marker_to_close?: String retries?: { disabled?: { } enabled?: { } } }".

venv/lib/python3.9/site-packages/dagster/core/definitions/config.py:84: DagsterInvalidConfigError
What is the correct run_config for multiprocess mode? (I'm running dagster 0.14.6)
a
hmm, are you setting
executor_def
on your
job
at all?
if im not mistaken, it appears the job has the
in_process_executor
set on the definition
a
Thanks it worked! Is there any process count limit by default?
@alex