mrdavidlaing
01/17/2021, 10:42 PMconfig_source.worker_concurrency
as below I was able to get a single Celery worker to run multiple solids concurrently on a 1 VCPU GKE node. (Not sure this is actually makes things faster; but it does seem to "work")
runLauncher:
type: CeleryK8sRunLauncher
config:
celeryK8sRunLauncher:
configSource:
worker_concurrency: 4