for each of the run, I see a new workload is getting added in my GKE cluster.. just wanted to understand if they are still incurring cost? will they get deleted automatically?

You can configure automatic deletion of your Kubernetes jobs by configuring a TTL on your cluster: https://kubernetes.io/docs/concepts/workloads/controllers/ttlafterfinished/

These are created by dagster when there's a new task to run, right? I'm thinking in hybrid setting, this is something which should be managed by Dagster? Some config like "delete pods once the process has finished"..?

Yes, these are tasks that are launched by the Dagster agent, but we defer to your Kubernetes cluster configuration on how to clean up these jobs, since that is natively handled as part of the Kubernetes API

Hmm right. Makes sense. Thanks!