hello there! I have a question regarding software-...
# ask-community
d
hello there! I have a question regarding software-defined assets 🙂 How can I go about such assets, with corresponding data already existing before I define them in Dagster? As a for instance, say I define a partitioned asset with data persisted on S3; if partitions exist prior to modelling the asset on Dagster, would I have to re-materialize these partitions in order to reflect reality within Dagster? Any other way to sync the two worlds?
Can I create AssetMaterialization events without actually touching the data?
s
Hey @Dimitris Stafylarakis - yes, my recommendation would be to run a job that logs a set of "fake" AssetMaterialization events that correspond to those partitions. Perhaps not the most elegant solution, but it should work
btw I filed an issue to track coming up with a better answer for this: https://github.com/dagster-io/dagster/issues/7389
d
hey @sandy thanks for the reply!