peay
09/27/2022, 9:33 AMrepoA
at repository location location
I'd like to pre-pend location
, repoA
to prefix_list
. I use different repository locations for different branches of my code (e.g., one repository location for the user code deployment for develop
, one repository location for the user code deployment for feature-1234
, etc.), and it'd be great to allow these to coexist easily.
I've seen utilities like prefix_assets but I am wondering whether there's a way to do this automatically for all repositories, taking the location into account as well.Joseph McCartin
09/27/2022, 10:19 AM__file__
property of the module where the asset is defined, and feed it to a function that returns the path, formatted with underscores instead of slashes. I do this for the asset_name
field in the asset decorator, but you could do this to the prefix list toopeay
09/27/2022, 11:42 AMworkspace.yaml
and is only known when Dagster loads a (possibly remote) user code deployment.
Ideally, if there was a way in workspace.yaml
to be able to set an option along those lines:
load_from:
- grpc_server:
location_name: "locationA"
prefix_asset_keys_with_location: true
...
that would prefix all asset key with locationA
Joseph McCartin
09/27/2022, 12:10 PMclaire
09/27/2022, 4:40 PM