sqlalchemy.exc.OperationalError: (sqlite3.Operatio...
# ask-community
m
sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked Hi team, I am getting the above error when running with the default
DagsterSqliteStorage
. Do you know how to solve without resorting to a more complex DB setup? The error manifest itself when running several concurrent runs in backfills. It appears as if setting the timeout can help (https://stackoverflow.com/questions/3172929/operationalerror-database-is-locked) - do you know how to do so?
d
Hey Marco - Sqlite is great for getting started with dagster, but I think ultimately getting to work at scale with work that's happening in parallel is just going to be an exercise in frustration since it really don't support concurrent access - even if you increased the timeout I suspect you would still see substantial slowdown as the various backfills sit and wait for each other to access the databases