https://docs.dagster.io/guides/dagster/how-assets-relate-to-ops-and-graphs#when-should-i-use-assets-or-ops-and-graphs is a start at explaining how to use assets in jobs which are fundamentally Op-ish. But it’s pretty barebones. I’m pretty uncertain about:
• Can I depend on a partitioned asset?
◦ How does the graph figure out which partition of the partitioned asset to use and pass in to my ops?
• How do IO managers figure in here? I have an asset which has a lot of custom logic for how it is serialized/deserialized (it’s a SQLite database file and a bunch of binary blobs). How do I use that?
Spencer Nelson
02/28/2023, 7:07 AM
As far as I can tell while trying this out, partitioning seems to be getting ignored. The IOManager is working, but it sees