Hi there, I have tested this pyspark code in K8S deployment . https://github.com/dagster-io/dagster/blob/master/examples/with_pyspark/with_pyspark/repository.py As soon as spark DataFrame is processed , I got this error.

java.io.IOException: Thread signal failed

But the wierd thing is the process as shown successful on dagit UI.

was this resolved by the above thread?

Yes thanks