https://dagster.io/ logo
#ask-community
Title
# ask-community
a

Akshay Krishnan

02/22/2024, 7:50 PM
Hello everyone! I've created an ETL pipeline on Dagster Now I need to run this pipeline once a week for a few different clients What is the most idiomatic way to achieve this in Dagster? What's bothering me is the concept of a software defined asset and how they are kept up to date over time If I run the pipeline once for client A and then for client B, I don't want client B's run to overwrite the state of the assets of client A and for client B's assets to be the "more up to date" version of the asset They are in fact different instances of the same "asset" and will each have their own up to date versions
z

Zach

02/22/2024, 8:02 PM
Very common use case, many folks use partitioned assets for this
daggy love 1
a

Akshay Krishnan

02/23/2024, 4:30 AM
Thank you sir Will read through and come back with questions, if any
c

Chris Roth

02/26/2024, 3:20 AM
100% partitioned assets.
👍 1
3 Views