Can two dagster daemon processes run on one server ubuntu Th

Question

Can two dagster daemon processes run on one server ubuntu The scenario is one for Development and the other for Production

daniel · Answer

Hey Will I think this could work but they d need to have totally independent storages and workspaces and dagster yaml DAGSTER HOME values We don t currently support having two dagster daemons for the same instance

Will Gunadi · Answer

< daniel> sure thing My question stems from the dagster daemon using some grpc comms so I wonder if we have to give it another name or something

daniel · Answer

I can t immediately think of anything that would break with that if two were running

daniel · Answer

but I haven t tried it so its hard to be 100 sure

Will Gunadi · Answer

Guess we ll find out smile

Will Gunadi · Answer

< daniel> So I ran the 2nd dagster daemon as a separate unix user When I run Dagit as the same user it says that the daemon is not running How do I tell dagit which daemon to connect to

daniel · Answer

they communicate with each other via the storage do you have two different databases running

daniel · Answer

and two different dagster yamls

Will Gunadi · Answer

Yes 2 dagster yaml

daniel · Answer

and two different DAGSTER HOMEs so that one daemon is writing to one database and the other is writing to the other database and similar with the two dagits

Will Gunadi · Answer

correct

daniel · Answer

That should be sufficient for the daemon heartbeats statuses to show up in the correct dagit

Will Gunadi · Answer

nope im an idiot

Will Gunadi · Answer

forgot export DAGSTER HOME=$PWD

Will Gunadi · Answer

for the dagit

Will Gunadi · Answer

I do wish that there is a more explicit way to tell dagit which daemon it should be watching for