Daniel Gafni
04/11/2023, 7:56 AMprha
04/11/2023, 9:37 PMupload_interval
argument to your gcs compute log manager configuration, it should upload the logs on some periodic interval.
e.g.
# in dagster.yaml
compute_logs:
module: dagster_gcp.gcs.compute_log_manager
class: GCSComputeLogManager
config:
bucket: "my-bucket"
upload_interval: 30 # every 30 seconds