https://dagster.io/ logo
c

Cris

08/04/2020, 7:55 PM
Hi all! Do you think that assets a good way to materialize a daily report (currently text and tabular data)? Or should we handle that independently saving the data to s3 and storing the metadata in our warehouse?
p

prha

08/05/2020, 5:26 PM
Hi Cris! Assets are the representation of artifacts external to dagster. In your example, they’d be a good way of tracing which pipeline runs actually produce / affect the daily report. The actual saving / storing the data is independent of this asset representation.
A good use of assets / materialization is to have your pipeline generate the daily report, and then yield an
AssetMaterialization
maybe with the location and metadata for that daily report. You could then have a view in Dagit on the Assets dashboard for that daily report, and see all the pipeline runs that produced that asset historically, along with their metadata.
c

Cris

08/05/2020, 5:43 PM
oh I see, thanks for the explanation and use case