Hey team, is it possible to set a default IO manag...
# ask-community
s
Hey team, is it possible to set a default IO manager on a given repository / on the k8s deployment? Currently a majority of our jobs don't have a persistent IO manager set currently which causes reruns that require inputs from other
ops
impossible. However we would like to not have to set io manager on every given job or need to create a helper around it. Wondering if there is a location in dagster I can set the default IO manager once and then have every job utilize that.
dagster bot responded by community 1
d
I use
with_resources
on a list of assets and set the “io_manager” key there
prod_assets = with_resources(
assets,
resource_defs={
"io_manager": s3_pickle_io_manager,
"parquet_io_manager": s3_parquet_io_manager,
"s3": s3_resource,
},
resource_config_by_key={
"io_manager": {
"config": {
"s3_bucket": "",
}
},
"parquet_io_manager": {
"config": {
"s3_bucket": "",
}
},
"s3": {"config": {"endpoint_url": "", "region_name": ""}},
},
)
The jobs built with these assets will use the IO manager set above
s
huh cool that makes sense