Lindsay S
12/19/2022, 5:13 PM@asset
def upstream_asset():
return [1, 2, 3]
@asset
def downstream_asset(upstream_asset):
return upstream_asset + [4]
resources_by_env = {
"prod": {
"io_manager": s3_pickle_io_manager.configured({
"s3_bucket": "my-bucket",
"s3_prefix": "prefix1"}),
"s3": s3_resource
},
"local": {"io_manager": fs_io_manager},
}
defs = Definitions(
assets=[upstream_asset, downstream_asset],
resources=resources_by_env[os.getenv("DAGSTER_DEPLOYMENT", "prod")],
)
sean
12/19/2022, 5:45 PMio_manager
is only the default io_manager
key-- you can create a separate io manager, store it under an arbitrary resource key, and separately configure the io manager for one of your assets:
@asset(io_manager_key='some_resource_key')
def downstream_asset(upstream_asset):
....
Lindsay S
12/19/2022, 5:49 PM