JCA User
02/27/2023, 6:56 PMworkspace.yaml
? I see an example for loading multiple python environments in dagit but the example only shows how to do it with python_file
, I'd like something like this for python_module
JCA User
02/27/2023, 7:00 PMpython_file
and that declaration has multiple sub-items, it seems like relative_path
is used instead. Not sure what the equivalent would be for modulessandy
02/27/2023, 10:20 PMJCA User
02/28/2023, 3:41 PMpython_module
. I want the equivalent of this but for modules:
load_from:
- python_file:
relative_path: path/to/dataengineering_spark_team.py
location_name: dataengineering_spark_team_py_38_virtual_env
executable_path: venvs/path/to/dataengineering_spark_team/bin/python
- python_file:
relative_path: path/to/team_code_location.py
location_name: ml_team_py_36_virtual_env
executable_path: venvs/path/to/ml_tensorflow/bin/python
I guess the specific question is what additional field would I declare the module in? Whatever is equivalent to relative_path
but for modules.JCA User
02/28/2023, 4:08 PMmodule_name
declared under a python_module
. Is there a page that summarizes the valid fields for the different types of ways to load a code location?