Hi again, just wanted to mention this in regard to...
# announcements
w
Hi again, just wanted to mention this in regard to Dagster-Dask: with the default (SQLite) run/schedule/event log storage, it's possible to get a
sqlite3.ProgrammingError: SQLite objects created in a thread can only be used in that same thread
error from the Dask worker. This happens intermittently, including when the worker is configured to use just 1 thread. It doesn't cause the pipeline to fail, just will show up in the worker's logs. I'm happy to PR a comment about this into the Dask executor docs (and maybe a recommendation to use the Postgres option?)
👍 1