Hi, is there any information comparing execution overheads for the various executors? I have used the k8s executor before and I know had lots of latency introduced by pod creation overheads, thinking maybe can shave some time there by using dask or celery. if nothing empirical just anecdotal evidence will do 😄

@johann - do you have thoughts here?

Lowest overhead would of course be in_process or multi_process- each run will take place inside a single K8s Job, so you’ll only pay the startup latency once.

Thanks 🙂