We've been running Dagster as a service locally, using the default SqliteRunStorage. Because some processes are slow, for example starting numerous backfills or displaying numerous partitions on Dagit, we want to move to PostgresRunStorage.
Is there a way to automatically migrate the historical data from Sqlite to Postgres, so we don't lose the history that was displayed on Dagit ?
11/03/2022, 3:33 PM
hmm, no tools explicitly for bulk migration.
You could use
dagster debug export
dagster debug import
run by run, or write a script similar to the implementation of those