Hi everyone, I wonder what is the use case for

databricks_pyspark_step_launcher

? What is the benefits of using

databricks_pyspark_step_launcher

over using an op to upload the

.py

file to databricks then use

create_databricks_job_op

to run databricks’ job?

Hey @Son Giang - this page compares those two approaches: https://docs.dagster.io/integrations/spark