Tomasz Tyżaj
02/20/2024, 11:28 AMttlSecondsAfterFinished
for JobSpecConfig and what for PodSpecConfigScout
02/20/2024, 11:28 AMttlSecondsAfterFinished
setting is a Kubernetes feature that allows you to automatically delete jobs and their associated pods after they have completed or failed for a specified amount of time. However, the documentation does not explicitly mention default settings for ttlSecondsAfterFinished
for either JobSpecConfig
or PodSpecConfig
. In Kubernetes, if ttlSecondsAfterFinished
is not set, it means that completed jobs are not automatically deleted. To use this feature, you typically need to set it explicitly in your job configuration. Additionally, the feature might require enabling a specific feature gate in your Kubernetes cluster, depending on the version of Kubernetes you are using. For Dagster's Kubernetes integration, you would configure ttlSecondsAfterFinished
within the jobSpecConfig
when defining your Kubernetes job through Dagster's API. If you need to set this value and it is not provided by default, you would specify it in your configuration when deploying your Dagster pipeline to Kubernetes. If you have further questions about configuring ttlSecondsAfterFinished
or if you need assistance with specific settings in Dagster's Kubernetes integration, please let me know, and I can help guide you through the configuration process or provide debugging advice.