https://dagster.io/ logo
j

Josh Taylor

04/08/2021, 8:18 AM
Hi! I've got 6 repositories, and noticed that the memory usage is "quite" (relative) high with the dagster daemon + dagit using around 1.3gb-2gb when it first boots. It seems to have multiple dagster processes (grpc etc) for each repository, is this normal?
d

daniel

04/08/2021, 11:05 AM
Hi Josh - which version of Dagster are you using currently?
j

Josh Taylor

04/08/2021, 11:51 AM
0.11.2
d

daniel

04/08/2021, 12:02 PM
does each repository have its own entry in your workspace.yaml? I'd expect there to be one process per workspace entry in the daemon (and one per entry in dagit as well)
j

Josh Taylor

04/09/2021, 2:20 AM
yeah it does, shouldn't it?
d

daniel

04/09/2021, 2:29 AM
It can, but it doesn't have to - you can define multiple repositories in a single file or python package (and if you wanted to reduce the number of running processes that's what I'd recommend - each entry in your workspace.yaml gets its own process)