Jacob Marcil
08/30/2023, 1:53 PM@asset(
io_manager_key="s3_csv_io_manager",
op_tags={"kind": "s3"},
)
def asset_to_s3(
context: OpExecutionContext
):
#get asset from somewhere
return Output(master_monthly_summary_report)
@asset(
io_manager_key="snowflake_io_manager",
op_tags={"kind": "s3"},
)
def asset_to_snowflake(
context: OpExecutionContext, asset_to_s3
):
return Output(asset_to_s3)
I would like to do something like
@asset(
backup_io_manager_key="s3_csv_io_manager",
io_manager_key="s3_csv_io_manager",
op_tags={"kind": "s3"},
)
def asset_to_s3(
context: OpExecutionContext
):
#get asset from somewhere
return Output(master_monthly_summary_report)
And store both the asset at both places at the same time.
Is there a way to do that in Dagster?Brendan Jackson
08/30/2023, 1:54 PMJacob Marcil
08/30/2023, 2:22 PMBrendan Jackson
08/30/2023, 2:23 PM