https://dagster.io/ logo
Title
d

David Weber

04/18/2023, 12:15 PM
Question regarding the integration with databricks, more specifically the following OP:
create_databricks_submit_run_op
We get the following error message:
Conflicting definitions found in repository with name '_databricks_submit_run_op'. Op/Graph definition names must be unique within a repository. OpDefinition is defined in job 'epl_12l_far' and in job 'epl_12l_mod'.
We define 2 jobs. In every job, we use this OP definition. So in total, we use this OP definition twice. But dagster apparently doesn't like that we use the OP
create_databricks_submit_run_op
twice. But how else are we supposed to create and run 2 jobs in databricks?