The cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability.

dagster

:wave: Is there any recommendation on how to clean up historical run data on dagster self hosted with a postgres backend? I was planning on cleaning up `event_log` and `runs` rows that were older than a certain date, but I don't know if this is a bad idea. Was also wondering how sensor cursor info is persisted, and if that will influence the method of cleanup as well. Thanks!

Hi Noah - have you seen this? <https://github.com/dagster-io/dagster/discussions/12047>

Hi Sandy, nope, but this is exactly what I was looking for, thanks!

Just wanted to make sure, will this have any impact on sensor cursors? We have buckets that have thousands of files that have already been processed and we wouldn't want those to suddenly be re-run after doing a cleanup.

Mind following up on the Github discussion? Alex, who wrote it, has more context than I do and will be able to offer a better answer