Leo Qin

05/16/2023, 7:19 PM
hello, since about 7am PT the majority of sensor ticks in our main deployment have failed due to timeout, these sensors had been healthy up until that point.
we did deploy this morning about 13 new asset sensors, is it possible that resources for processing sensors ticks have been exhausted?
the other sensor that is failing is our asset reconciliation sensor
yes... i disabled the 13 new sensors and the asset reconciliation sensor is now ticking successfully
we reduced the frequency of those asset sensors and we're back to stable now.


05/16/2023, 8:50 PM
good to know - i’m looking into this to see if there’s any obvious performance bottleneck on our end