Running on a skeletal crew here, didn't realise that our normal jobs are taking >6x time to complete, usually it would finish within 10 mins and now taking 60+ mins. Wondering if there was a way to add monitoring for anomalies in dagster cloud? p.s. not looking forward to the larger bill at month end... blob sad
03/24/2023, 4:15 PM
We don’t have anomaly detection on run duration on dagster cloud, no. You might be able to manually tune something by hardcoding expected max durations per job and then calculating the run duration of each just completed run using a run status sensor.