Stefan Otte
06/23/2022, 3:43 PMxyz_plot
and I want to reuse this function in multiple projects, i.e. xyz_plot
should use project-a/data.csv
and project-b/data.csv
(or the resulting DataFrame of the csv) as input. How do I have to define the xyz_plot
?
@asset
def xyz_plot(in_key: DataFrame):
# how should in_key be really named? in_key is not fixed
sandy
06/23/2022, 8:04 PMproject_a_data = SourceAsset(key=["project_a", "data"])
project_b_data = SourceAsset(key=["project_b", "data"])
@op
def xyz_plot(in_key: DataFrame):
...
plot_a = AssetsDefinition.from_op(xyz_plot, keys_by_input_name={"in_key": AssetKey(["project_a", "data"])})
plot_b = AssetsDefinition.from_op(xyz_plot, keys_by_input_name={"in_key": AssetKey(["project_b", "data"])})
Stefan Otte
06/25/2022, 2:51 PMop
and AssetsDefinition.from_op
approach for pretty much everything as all assets depend on an unbound dependency...I think. I have to play around with this.Stefan Otte
06/25/2022, 2:53 PMAssetsDefinition.from_op
https://github.com/dagster-io/dagster/releases/tag/0.15.1)