https://dagster.io/ logo
#dagster-feedback
Title
# dagster-feedback
b

Binoy Shah

06/07/2022, 1:33 PM
Does anybody have experience with age and scalability of Dagster after running couple 100Ks of jobs. How does Db maintenance and job/dagit scaling work. Are there any Job pruning recommended/facilitated ? it would be nice if there were a command that does it
dagster prune --keep-last-days 10
dagster prune --keep-last-jobs 50000
any thoughts on growth and maintenance of dagster? I have read horror stories with scaling of Airflow jobs, wanted to hear more about veteran dagster users on the same. Moderators, please let me know if this discussion topic is appropriate for this channel.
💡 2
j

johann

06/07/2022, 8:25 PM
Job pruning- that’s definitely something we have in mind to support natively in a future release. It’s possible currently via the graphql api: https://dagster.slack.com/archives/C01U954MEER/p1654613204152099?thread_ts=1654591483.152539&cid=C01U954MEER