19913d85-f662-4518-a9a1-7adc1793dfd4.png){kind=small}
Guys, any way to tell dagster to clean finished jo...
# deployment-kubernetesr
Rubén Lopez Lozoya
03/26/2021, 11:26 AMGuys, any way to tell dagster to clean finished jobs after execution in kubernetes?
j
johann
03/26/2021, 1:17 PMHi @Rubén Lopez Lozoya, we use the TTL feature but unfortunately it’s not supported by many k8s distributions currently https://kubernetes.io/docs/concepts/workloads/controllers/ttlafterfinished/#ttl-controller. As an alternative, you can use a cluster plugin that manages gc:
https://github.com/lwolf/kube-cleanup-operator
https://github.com/aramse/k8s-job-reaper
johann
03/26/2021, 1:19 PMIt’s also an option to just setup a cron job yourself, with the following commands.
This example deletes dagster jobs older than one day:
kubectl get job | grep -e dagster-run -e dagster-job | awk 'match($4,/[0-9]+d/) {print $1}' | xargs kubectl delete jobkubectl get pod | grep -e dagster-run -e dagster-job | awk 'match($3,/Completed/) {print $0}' | awk 'match($5,/[0-9]+d/) {print $1}' | xargs kubectl delete pod👍 1
👍🏾 1
johann
03/26/2021, 1:21 PM@Dagster Bot docs K8s Job/Pod ttl help
d
Dagster Bot
03/26/2021, 1:21 PMCreated issue at: https://github.com/dagster-io/dagster/issues/3948
r
Rubén Lopez Lozoya
03/26/2021, 1:35 PMthanks!
n
Noah K
03/26/2021, 2:24 PMTTL controller is moving to beta in 1.21 last I looked, so will be supported soon 🙂
👍 1
r
Rubén Lopez Lozoya
03/26/2021, 2:25 PMamazing