Hey folks, is there an equivalent for the multipro...
# ask-community
c
Hey folks, is there an equivalent for the multiprocess_executor that lets you execute via python? In other words,
execute_in_process
but run assets in their own process in parallel if they're not dependent on eachother?
c
Confused - what do you mean by execute via python? The multiprocess executor still runs python-based subprocesses
c
I guess my goal is to set up a script that runs a job that does this. the
execute_in_process
function gets us part of the way there, but it only executes the ops synchronously...
from the docs it seems like the multiprocess executor can only be used when launching jobs from the dagster daemon?
likewise, is there a way to run
materialize
in a multi-threaded way?
c
You can use
execute_job
to use different executors from a pythonic interface
🙏 1