Vanessa Cai
08/31/2023, 11:05 PMshared
and lib
(and other libraries within `~/dev`:
~/dev/
├─ shared/
├─ lib/
├─ dagster_project/
│ ├─ dagster_project/
│ │ ├─ assets.py
│ │ ├─ __init__.py
│ ├─ dagster_cloud.yaml
│ ├─ setup.py
when i try to deploy from within ~/dev/dagster_project
, it fails because of the missing dependencies on shared
and lib
; when i deploy from ~/dev
, it fails because it can't find the correct dagster_project
module. what's the correct command or process here?Sean Lopp
09/01/2023, 4:07 PMml_project
in this repo: https://github.com/slopp/dagteam/tree/main. As documented in the bottom of that repo's readme, the steps are:
(a) deploy from ~/dev, but with dagster_cloud.yaml
in the root /dev
directory
(b) use the build
argument within dagster_cloud.yaml
to point at dagster_project
(c) have the CICD process copy shared and lib into the dagster_project, and then install those libraries using an appropriate reference in setup.py
or a dagster_project/requirements.txt
fileVanessa Cai
09/01/2023, 6:56 PM