The cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability.

dagster

Hi all! Has anyone ever found a pattern for creating an op that can take in any arbitrary `AssetKey` via op configuration?

My workaround has been to include the s3 location in the output metadata of the upstream SDA and use UPath configuration to allow consumer of the op to pass in an s3 key, but it would be nice to avoid the indirection and directly reference the asset key

could do something like this: `asset_key = AssetKey(context.op_config["asset"])`

Ah yeah! And I could just re-use the io manager `load_input` definition to turn that into the actual dataset. I think that should totally work