Charles Couble
02/14/2023, 3:52 PMinstall_requires=[
"dagster",
"dagster-cloud",
"boto3",
"pandas",
'internals @ git+<https://my-private-repo>@github.com/repo.git']
Which works in local, by executing the pip install -e '.[dev]'
command.
Therefore, it seems like the deploy fails on the CI/CD github action with the error shown on the screenshot.
(It looks like github actions try to fetch for a local directory)
Does anyone have an idea about how to solve this issue ?Shalabh Chaturvedi
02/14/2023, 5:23 PM- name: Checkout internal repo
uses: actions/checkout@v3
with:
token: ${{ secrets.GH_PAT }}
repository: private-org/internal-repo
path: deps/internal-repo
- name: Build internal repo into a wheel
run: >
cd deps/internal-repo &&
python setup.py bdist_wheel &&
cp dist/*whl $GITHUB_WORKSPACE/deps
- name: Configure dependency resolution to use locally built deps/
run: >
echo "[global]" > $GITHUB_WORKSPACE/deps/pip.conf &&
echo "find-links = " >> $GITHUB_WORKSPACE/deps/pip.conf &&
echo " file://$GITHUB_WORKSPACE/deps/" >> $GITHUB_WORKSPACE/deps/pip.conf &&
echo "PIP_CONFIG_FILE=$GITHUB_WORKSPACE/deps/pip.conf" > $GITHUB_ENV
&& cat $GITHUB_WORKSPACE/deps/pip.conf
&& ls $GITHUB_WORKSPACE/deps/
2. Create a github personal access token and set it as the GH_PAT
secret for your actions.
3. You may need to fix the "Build internal repo" to cd into the right directory within your internal repo
4. Replace "internals @ git+https..."
in your setup.py with just "internals"
.
The PIP_CONFIG_FILE points the dependency resolution to use the locally build wheel for the "internals" package. Let us know if this helps.Charles Couble
02/15/2023, 9:15 AMShalabh Chaturvedi
02/15/2023, 6:08 PMCharles Couble
02/16/2023, 3:34 PM