Question about project structure What are people considering

Question

Question about project structure What are people considering to be best practices for setting up a repository to handle pipelines pertaining to different lines of business

schrockn · Answer

Hey Tobias Been awhile slightly smiling face I don t think there is any strong guidance or best practices around that Without further context I would just maybe make a file per line of business and then go from there

Tobias Macey · Answer

It has indeed slightly smiling face I m finally getting around to actually writing something with Dagster

Tobias Macey · Answer

My thinking is to use a repository per line of business but I was curious if there s a way to group repositories to view them at a higher level Essentially treating a repository as the boundary between lines of business and then having a UI to select a repository and then run or view the associated pipelines

Tobias Macey · Answer

I know that doesn t exist currently but might be an interesting feature for others as well

Tobias Macey · Answer

Alternatively a means of viewing and controlling multiple installations of dagit so that you can do a federated installation

schrockn · Answer

Yes we are actively working on figuring this stuff out supporting multiple containers and repositories per dagit instance

schrockn · Answer

For each dagit instance loads a single repository so if you wanted strict separation you would need to run multiple dagit instances

Eric · Answer

< Tobias Macey> unrelated to this topic but wanted to mention as someone with a more than 4 hour commute into work everyday both your podcasts help keep me sane Keep up the great work

Tobias Macey · Answer

Thanks for listening slightly smiling face

Tobias Macey · Answer

Also that s a hell of a commute