https://dagster.io/ logo
#dagster-support
Title
# dagster-support
n

nickvazz

08/16/2022, 3:39 PM
Hello! I am looking to bring dagster to our organization but I'm having a tricky time understanding how to properly set up software defined assets for our use case. We run many finite event simulations and each produce a few artifacts and have their own IDs associated with them. It seems like each asset would be closer to an aggregated set of all artifacts with a global materialization. Am I misunderstanding something? Is there a way to make many software defined assets following the same structure but from an initial configuration?
🤖 2
s

sandy

08/16/2022, 3:42 PM
It seems like each asset would be closer to an aggregated set of all artifacts with a global materialization.
That's how I would model it in your case. If the set of artifacts is known ahead of time, you could use partitions to represent them. Otherwise, you could specify which artifacts to touch by using config (which you can set at runtime)
n

nickvazz

08/16/2022, 3:48 PM
I had not seen partitions in the docs but that looks closer to what I had imagined! Thank you for the quick response :)
2 Views