https://dagster.io/ logo
#ask-community
Title
# ask-community
s

salil saifuddin

02/21/2024, 11:50 AM
Log rolling for compute logs based on size: We have configured the log rolling retention to purge logs after a certain number of days using the following configuration in the dagster.yaml file. Is there any way to trigger a purge when the log size reaches a specific threshold?. Is there a way to configure the purging of compute logs based on a predefined period or size? dagster.yaml file
Copy code
retention:
  schedule:
    purge_after_days: 90
  sensor:
    purge_after_days:
      skipped: 7
      failure: 30
      success: -1
d

Daniel Gafni

02/21/2024, 1:59 PM
I might be wrong but I don't think something like this is available. Here are the docs for that is currently possible: https://docs.dagster.io/deployment/dagster-instance#data-retention
4 Views