anyone see similar issues with a sensor doing this to your c

Question

anyone see similar issues with a sensor doing this to your code location pod

Charlie Bini · Answer

it s building resources using secrets from that code location and running some external queries but something appears to be persisting in memory after each tick and eventually running it out of memory

Charlie Bini · Answer

adding some manual garbage collection `gc collect ` seems to have fixed it

Charlie Bini · Answer

image png

Charlie Bini · Answer

still a mystery of what wasn t getting flushed but no longer crashing

daniel · Answer

This might depend a lot on the exact code of your sensor do you have something that could be in a contextmanager but isnt

Charlie Bini · Answer

good idea yeah I m using an tunnel from dagster ssh but calling stop and start explicitly

Charlie Bini · Answer

i ll test out if using it as a contextmanager changes anything

daniel · Answer

Alternately maybe calling stop in a finally block would have a similar effect if the sensor raises an exception you d still want stop to be called

Charlie Bini · Answer

yeah the SSHTunnelForwarder start method doesn t actually seem to support a context manager usage

Charlie Bini · Answer

gonna see what a finally block can do at least