Does anybody have experience with age and scalability of Dagster after running couple 100Ks of jobs. How does Db maintenance and job/dagit scaling work. Are there any Job pruning recommended/facilitated ? it would be nice if there were a command that does it

dagster prune --keep-last-days 10

dagster prune --keep-last-jobs 50000

any thoughts on growth and maintenance of dagster? I have read horror stories with scaling of Airflow jobs, wanted to hear more about veteran dagster users on the same. Moderators, please let me know if this discussion topic is appropriate for this channel.

Job pruning- that’s definitely something we have in mind to support natively in a future release. It’s possible currently via the graphql api: https://dagster.slack.com/archives/C01U954MEER/p1654613204152099?thread_ts=1654591483.152539&cid=C01U954MEER