https://dagster.io/ logo
#ask-community
Title
# ask-community
g

Guru Prasath

12/14/2022, 7:51 PM
Can I use DATABRICKS Cluster compute for DAGSTER instance job run ?
j

jamie

12/14/2022, 8:55 PM
hey @Guru Prasath we have a databricks integration here https://docs.dagster.io/_apidocs/libraries/dagster-databricks it’s on our short list to improve this integration, so if you have feature requests, feel free to open github issues
👍 1
g

Guru Prasath

12/14/2022, 9:14 PM
Can you share the sample (code / syntax) for executing jobs on databricks?
When I say job, it is Dagster job
j

jamie

12/14/2022, 9:30 PM
there are some examples in our pyspark guide https://docs.dagster.io/integrations/spark
g

Guru Prasath

12/14/2022, 9:34 PM
I don't want the pyspark implementation, I just want to run my dagster job on databricks
j

jamie

12/14/2022, 9:55 PM
right. I thought the example showed submitting a pyspark job to databricks that you could look at to see how to submit your own job to databricks. but it’s just mentioned as a possibility (my bad). In that case, I don’t know if we have examples other than the code snippets in the API docs
g

Guru Prasath

12/14/2022, 9:57 PM
Okay, Thanks for response @jamie
8 Views