https://dagster.io/ logo
#ask-ai
Title
# ask-ai
s

Selim Raboudi

02/23/2024, 8:53 PM
@Scout here is my file structure: setup.py dagster_cloud.yaml dagster/ common/ didag_common/ setup.py pipelines/ hubspot/ setup.py didag_hubspot/ pipeline_2/ I want to add didag_common as a dependency of didag_hubspot. Tell me how should be the setup.py in hubspot/ directory
s

Scout

02/23/2024, 8:53 PM
To add
didag_common
as a dependency of
didag_hubspot
, you will need to modify the
setup.py
file in the
hubspot/
directory. The
setup.py
file is used to configure your project and its dependencies. According to the documentation, the
setup.py
file allows you to specify any Python packages you will need for your project. Here's a general structure of how the
setup.py
file in the
hubspot/
directory might look:
Copy code
python
from setuptools import find_packages, setup

setup(
    name="didag_hubspot",
    version="0.1.0",  # Replace with your desired version
    packages=find_packages(),
    install_requires=[
        "dagster",
        "dagster-cloud",
        # Add your local package as a dependency using a relative file path
        "didag_common @ file://../common/didag_common"
    ],
    # Include any other necessary setup configurations
)
In the
install_requires
list, you can specify the path to the
didag_common
package using a relative file path with the
file://
URI scheme. This assumes that
didag_common
is structured as a Python package and can be installed using
pip
. Please note that the exact syntax for specifying a dependency with a relative file path may vary depending on your environment and the version of
setuptools
you are using. The example above assumes that
didag_common
is located at a relative path from the
hubspot/
directory and that it includes a
setup.py
file that allows it to be installed as a package. If
didag_common
is not structured as an installable package or if you encounter any issues with the relative path, you may need to adjust the path or consider packaging
didag_common
appropriately. Remember to replace
"0.1.0"
with the actual version number of your
didag_hubspot
package and to include any other dependencies or setup configurations that are specific to your project. Dagster project files | Dagster Docs button Best Practices in Structuring Python Pro... button From Python Projects to Dagster Pipeline... button How do I deploy an existing Dagster proj... button Thank you for your feedback!
s

Selim Raboudi

02/23/2024, 9:24 PM
@Scout I have a monorepo. Can I make one python package depend on another ? Give me an example file structure and setup.py