Hi team! What is the recommended way for using IO ...
# ask-community
d
Hi team! What is the recommended way for using IO managers to incrementally add rows (or even upsert) to an asset? I know the IO manager's intended use is to delete and recreate the entire asset, so I was wondering what would be the best method for an incremental approach here.
👀 1
powerup 1
🤖 1
s
I think you need to write a custom IO manager for this. Here’s are some example custom IO managers: https://docs.dagster.io/concepts/io-management/io-managers#a-custom-io-manager-that-stores-pandas-dataframes-in-tables