sephi
03/15/2020, 8:57 AMyou may find that invoking Dask or Pyspark directly from within the body of a solid’s compute function is a better fit than the engine layer covered in this documentation.Do you have an example to invoke Dask execution compute function from within a
solid
, we are running on a cloudera
environment and need to run the solid process with dask-yarn.
any advice would be appreciated.nate
03/15/2020, 3:44 PM