Ben Lindsay

10/29/2020, 5:30 PM
I'm probably missing something obvious, but I'm trying to figure out how to programmatically kick off execution of a pipeline from python without having to wait for the results. My use case is something like a streamlit app as a frontend where people can submit input data to be processed in an hours-long process. For short processes, I'm able to use
, but I don't want to have Streamlit spinning for hours while it waits for completion. Do I have to go straight to Dask or Celery to be able to do this or can I accomplish something like this as a test case with just 1 processor/thread?