Hi team, is there any tentative plan on which version would parallel sensor support be released https://github.com/dagster-io/dagster/pull/8642? We have too many sensors running on our workspace and they are lagging a lot. This would be very useful to us
06/30/2022, 12:01 AM
this should be released tomorrow for 0.15.3, cc @prha
06/30/2022, 12:03 AM
Wow, excellent 🙂
Follow up question: Because of the sheer number of sensors, our run status sensor is not running frequently and is constantly lagging. Is there any concept of sensor priority that I can set to make sure it runs as per the minimum interval?
06/30/2022, 6:47 PM
There’s no concept of sensor priority, but we’re looking into introducing more parallelism for sensors to prevent it from running behind.