Can I use DATABRICKS Cluster compute for DAGSTER i...
# ask-community
g
Can I use DATABRICKS Cluster compute for DAGSTER instance job run ?
j
hey @Guru Prasath we have a databricks integration here https://docs.dagster.io/_apidocs/libraries/dagster-databricks it’s on our short list to improve this integration, so if you have feature requests, feel free to open github issues
👍 1
g
Can you share the sample (code / syntax) for executing jobs on databricks?
When I say job, it is Dagster job
j
there are some examples in our pyspark guide https://docs.dagster.io/integrations/spark
g
I don't want the pyspark implementation, I just want to run my dagster job on databricks
j
right. I thought the example showed submitting a pyspark job to databricks that you could look at to see how to submit your own job to databricks. but it’s just mentioned as a possibility (my bad). In that case, I don’t know if we have examples other than the code snippets in the API docs
g
Okay, Thanks for response @jamie