Question about project structure. What are people considering to be best practices for setting up a repository to handle pipelines pertaining to different lines of business?
03/16/2020, 7:45 PM
Hey Tobias! Been awhile 🙂 I don't think there is any strong guidance or best practices around that. Without further context I would just maybe make a file per line of business and then go from there?
03/16/2020, 7:51 PM
It has indeed 🙂 I'm finally getting around to actually writing something with Dagster.
My thinking is to use a repository per line of business, but I was curious if there's a way to group repositories to view them at a higher level. Essentially treating a repository as the boundary between lines of business and then having a UI to select a repository and then run or view the associated pipelines?
I know that doesn't exist currently but might be an interesting feature for others as well.
Alternatively, a means of viewing and controlling multiple installations of dagit so that you can do a federated installation.
03/16/2020, 9:22 PM
Yes we are actively working on figuring this stuff out supporting multiple containers and repositories per dagit instance
For each dagit instance loads a single repository so if you wanted strict separation you would need to run multiple dagit instances
03/17/2020, 6:16 PM
@Tobias Macey unrelated to this topic but wanted to mention, as someone with a more than 4 hour commute into work everyday both your podcasts help keep me sane ! Keep up the great work !