sephi03/15/2020, 8:57 AM
you may find that invoking Dask or Pyspark directly from within the body of a solid’s compute function is a better fit than the engine layer covered in this documentation.Do you have an example to invoke Dask execution compute function from within a
, we are running on a
environment and need to run the solid process with dask-yarn.
any advice would be appreciated.
nate03/15/2020, 3:44 PM