Alex Molotsky
03/28/2022, 2:04 PMexecute_pipeline(reconstructable(my_job_wrapped))
Unfortunantly I'm getting the following error (I'm running Dagster without any DAGSTER_HOME). what would be the easiest run_config to make it work?
dagster.core.errors.DagsterUnmetExecutorRequirementsError: You have attempted to use an executor that uses multiple processes with an ephemeral DagsterInstance. A non-ephemeral instance is needed to coordinate execution between multiple processes. You can configure your default instance via $DAGSTER_HOME or ensure a valid one is passed when invoking the python APIs.
alex
03/28/2022, 3:00 PMinstance=DagsterInstance.get()
to execute_pipeline
to have it use your “real” instance or DagsterInstance.local_temp(...)
to use an FS backed temp instance