https://dagster.io/ logo
#ask-community
Title
# ask-community
y

Yamamoto Hironori

07/16/2023, 5:58 PM
Hi, I deployed dagster on k8s by helm chart and code locations. I found the concurrency of asset jobs is always under 4, when they are kicked by one schedule, even though I did not set any tag concurrencies. Then, I tried to update the options which are set to 4 in default, but it does not affect the results. https://github.com/dagster-io/dagster/blob/af19845a41346d2fe1011d302207673e015009df/helm/dagster/values.yaml#L1068-L1137 Can anyone knows the options for increasing the number of concurrent asset jobs?
I update
max_concurrent
of executor config and it works as expected.
Copy code
execution={
        "config": {
            "multiprocess": {
                "max_concurrent": 1000,
I think the value is defined by the CPU resources.