Andrea02/04/2023, 10:12 AM
Grigorii Kushnir02/04/2023, 6:42 PM
Andrea02/05/2023, 8:01 AM
as a way to load code locations. But how to add/change code locations on an existing dagster deployment without having to restart it?
Grigorii Kushnir02/05/2023, 8:08 AM
Andrea02/05/2023, 8:09 AM
Grigorii Kushnir02/05/2023, 8:10 AM
Andrea02/05/2023, 8:10 AM
Grigorii Kushnir02/05/2023, 8:12 AM
Andrea02/05/2023, 8:13 AM
Grigorii Kushnir02/05/2023, 8:13 AM
Andrea02/05/2023, 8:16 AM
Grigorii Kushnir02/05/2023, 8:18 AM
Looks like dagster is not for us. I'm just baffled they don't have a simple API to add dags to the orchestrator. Both airflow and Prefect have itYou could end up just updating your code in a some specific approach, git submodules maybe from what I imagine you might have.
Andrea02/05/2023, 8:22 AM
Grigorii Kushnir02/05/2023, 8:24 AM
I read the article but don't get how it would help. So every one of my projects would have a Definition which says what assets, schedules etc. I need to have for that project. I have hundreds of projects not sharing storage each having its definition file. Each project needs to set up its grpc and dagster needs to be updated every time hard coding the IP of each grpc node to find each definition file. Correct?No, read the whole discussion.
Andrea02/05/2023, 8:29 AM
Grigorii Kushnir02/05/2023, 8:51 AM
When you add or remove a user code container, you can also remove the corresponding entry from your workspace.yaml file. If this file is mounted on the Dagit and Dagster daemon containers as a volume, you can pick up the changes in Dagit by reloading from the Deployment tab. The Dagster daemon container will automatically pick up the changes by periodically reloading the workspace.yaml file.