19913d85-f662-4518-a9a1-7adc1793dfd4.png){kind=small}
hello, since about 7am PT the majority of sensor t...
# dagster-plusl
Leo Qin
05/16/2023, 7:19 PMhello, since about 7am PT the majority of sensor ticks in our main deployment have failed due to timeout, these sensors had been healthy up until that point.
Leo Qin
05/16/2023, 7:20 PMwe did deploy this morning about 13 new asset sensors, is it possible that resources for processing sensors ticks have been exhausted?
Leo Qin
05/16/2023, 7:23 PMthe other sensor that is failing is our asset reconciliation sensor
Leo Qin
05/16/2023, 7:32 PMyes... i disabled the 13 new sensors and the asset reconciliation sensor is now ticking successfully
Leo Qin
05/16/2023, 8:48 PMwe reduced the frequency of those asset sensors and we're back to stable now.
j
jordan
05/16/2023, 8:50 PMgood to know - i’m looking into this to see if there’s any obvious performance bottleneck on our end