This was in the middle of a flurry of errors so I m guessing

Question

This was in the middle of a flurry of errors so I m guessing it s some weird timing issue

daniel · Answer

Is it possible to post the other errors This was the launcher that starts up runs in their own threads but all in the same process

Noah K · Answer

The other errors were legit pipeline failures solid raised an exception

Noah K · Answer

It seems like about 50 failed with that error and 50 with the solid exception

Noah K · Answer

This was with about 700 pipeline runs launched simultaneously

Noah K · Answer

And yeah each run in a thread inside a celery worker process

Noah K · Answer

Not something I ve seen before hence the guess that s related to hundreds of runs failing almost immediately smile

Noah K · Answer

Might have been a connection overload on the gRPC daemon

Noah K · Answer

It doesn t have any logging output so hard to tell if it was sad from the rush of connections