geoHeil
04/14/2023, 8:07 AMDAGSTER_CLOUD_IS_BRANCH_DEPLOYMENT
When building custom IO managers - let`s say for ML flor or file based data (HFS, S3, ....) I might want to include the branch into the asset key prefix for branch deployments. How can I obtain a reference to the current branch? For such a branching IO manager where can I find examples? https://github.com/dagster-io/hooli-data-eng-pipelines/blob/master/hooli_data_eng/definitions.py#L108-L190 seems to only switch to BRANCH
and then supply different credentials (the same for all branches). I want to have something different: Similar to DBT sim-ci a different logical key prefix (branch name) should be added somewhere (and yes most likely not the production resource should be used as well.Sean Lopp
04/14/2023, 1:21 PMgeoHeil
04/15/2023, 7:26 AMgeoHeil
04/15/2023, 7:29 AMgeoHeil
04/15/2023, 7:29 AMgeoHeil
04/15/2023, 7:30 AMSean Lopp
04/17/2023, 2:42 PMgeoHeil
04/17/2023, 9:01 PMgeoHeil
04/17/2023, 9:02 PMSean Lopp
04/18/2023, 1:31 PM