when I am trying Pyspark connect with Dagster getting errors

Question

Ronak Jain · Answer

cc < sashank> will look into

Ronak Jain · Answer

cc < daniel>

sashank · Answer

hey ronak this seems to be an error in your user code not a framework level error

Ronak Jain · Answer

Ok Which configure we need to do here I m new in PySpark

sashank · Answer

Unfortunately I can t help help too much here since this error is not Dagster related I d encourage you to try to get this working outside of Dagster first so that you can isolate the problems

sashank · Answer

sashank · Answer

Here s a relevant post that has some suggestions on how to tackle this error

Ronak Jain · Answer

Could you share any github simple example pyspark with dagster

sashank · Answer

Ronak Jain · Answer

Thanks < sashank>