Mycchaka Kleinbort
11/24/2022, 3:45 PM.../my-dagster-project/tmpav872908/storage/{assetkey}
Vinnie
11/24/2022, 3:54 PMMycchaka Kleinbort
11/24/2022, 4:01 PMfs_io_manager.configured({'base_dir':'<D://Users/mkleinbort/Downloads/'}>)
@asset(group_name="snowflake_data", io_manager_key=fs_io_manager)
def companyIds()->list[int]:
return [1,2,3]
base_path = UPath(
init_context.resource_config.get(
"base_path", init_context.instance.storage_directory()
)
)
from https://docs.dagster.io/concepts/io-management/io-managers#custom-filesystem-based-io-managerVinnie
11/24/2022, 4:06 PM@asset(group_name="snowflake_data", io_manager_key=configured_fs_io_manager)
def companyIds()->list[int]:
return [1,2,3]
@repository
def repo():
resource_defs = {
"configured_fs_io_manager": fs_io_manager.configured({'base_dir':'<D://Users/mkleinbort/Downloads/'}>),
}
return [
*with_resources(
definitions=[
companyIds,
],
resource_defs=resource_defs,
),
]
fs_io_manager
, this is just to illustrate the explicitly configured optionMycchaka Kleinbort
11/24/2022, 4:08 PMVinnie
11/24/2022, 4:18 PMresources:
fs_io_manager:
config:
auth:
base_path: /my/cool/path