Hello, I work in an MLOps team that manages multiple projects spread over a number of git repositories. Is it possible to have a single Dagit UI that interfaces these succinctly (each project with it’s own resource requirements, schedule etc).
🤖 1
d
David Hyman
06/21/2022, 11:30 AM
yes
https://docs.dagster.io/concepts/repositories-workspaces/workspaces#loading-multiple-repositories
The repositories will show up independently on the UI
But only through a single Dagster deployment; that is, you can't aggregate multiple existing Dagster deployments. Your single deployment would need a workspace that could access all the "number of git repositories" e.g. in a dockerised deployment by having them all in the same image
m
MO
06/21/2022, 12:11 PM
Hi thanks for your reply. So essentially if I wanted to keep the git repositories separate but a single UI I would need some mechanism to pull together the disparate repositories, build the virtual environments for each one and Dockerise or otherwise deploy?
d
David Hyman
06/21/2022, 1:22 PM
for what you've described, that sounds about right nod2
how that happens 🤷 maybe multistage docker, or establishing the repos as individual python packages etc. Good luck