Hi! I've got 6 repositories, and noticed that the memory usage is "quite" (relative) high with the dagster daemon + dagit using around 1.3gb-2gb when it first boots. It seems to have multiple dagster processes (grpc etc) for each repository, is this normal?
04/08/2021, 11:05 AM
Hi Josh - which version of Dagster are you using currently?
04/08/2021, 11:51 AM
04/08/2021, 12:02 PM
does each repository have its own entry in your workspace.yaml? I'd expect there to be one process per workspace entry in the daemon (and one per entry in dagit as well)
04/09/2021, 2:20 AM
yeah it does, shouldn't it?
04/09/2021, 2:29 AM
It can, but it doesn't have to - you can define multiple repositories in a single file or python package (and if you wanted to reduce the number of running processes that's what I'd recommend - each entry in your workspace.yaml gets its own process)