Joel Olazagasti
04/14/2023, 3:07 PMkey_prefix
for schema information, and only use the schema value from the passed Snowflake IO manager? We run & test our pipelines in different schema configurations based on local dev, branch qa, and production, but ideally would like the visual organization of the assets in the UI to stay consistent between environments. So the goal would be to have static key_prefixes
and dynamic io_manager schema configuration, that won't overlap in values["db_name", "schema_name"]
as key prefixes. This makes aligning with key prefixes generated by DBT a lot simpler, and keeps our UI organized nicely. Does Dagster just attempt to load the asset into multiple schemas in this case?jamie
04/14/2023, 7:38 PM["db_name", "schema_name"]
then the io manager only picks the last key prefix. So in this case, it will store in schema_name