Hi I downloaded the github example with pyspark, but it doesn't worked. Here is the error message:

@yuhan is there some hadoop configuration that needs to be set for this example project?

Any News?

Hi @Ismael Rodrigues apologies for the delay — I was out of office. Did you have spark installed in your environment?

I've just installed pyspark

In addition to

pip install pyspark

, you’ll also need to install Spark: https://spark.apache.org/downloads.html

Oh god, amateur's mistake, I'm sorry

no worries at all. we’ll make it clear in the instructions.

Created issue at: https://github.com/dagster-io/dagster/issues/10228