Hi everyone, I'm trying to run run Dagster in my t...
# ask-community
a
Hi everyone, I'm trying to run run Dagster in my test environment. I need to run it locally in a multiprocess mode, and at the end get the results 'in memory'. I tried using the old pipeline API:
Copy code
execute_pipeline(reconstructable(my_job_wrapped))
Unfortunantly I'm getting the following error (I'm running Dagster without any DAGSTER_HOME). what would be the easiest run_config to make it work?
Copy code
dagster.core.errors.DagsterUnmetExecutorRequirementsError: You have attempted to use an executor that uses multiple processes with an ephemeral DagsterInstance. A non-ephemeral instance is needed to coordinate execution between multiple processes. You can configure your default instance via $DAGSTER_HOME or ensure a valid one is passed when invoking the python APIs.
a
you have to pass
instance=DagsterInstance.get()
to
execute_pipeline
to have it use your “real” instance or
DagsterInstance.local_temp(...)
to use an FS backed temp instance