The cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability.

dagster

Hey dagster team! If i wanted to override an op in gcp like, import_df_to_bq, is there a way i can, override this to always provide a destination to reduce the configuration? e.g., i want an op that turns into import_df_to_&lt;my_table_name&gt;_in_bq

then in configuration, remove the need to specify the destination in the BIGQUERY_LOAD_CONFIG?

The op factory pattern might be what you're looking for <https://docs.dagster.io/concepts/ops-jobs-graphs/ops#op-factory>

thanks jamie! can you provide me an example of how i would use this? would i add the destination into "ins"?

Ah nevermind, ins is for dependencies. i see the **kwargs argument, so i would then reduce the destinations kwarg :slightly_smiling_face: . OK thanks! I'll give it a test

<@U02RSSRR325> what do you think of this pattern instead of using @configured? just food for thought we can test out later.

it’s pretty much the same as what I proposed with my <https://gist.github.com/phil-evoiq/2963f2c478ab03b3bab6e2167571c0d5#file-repo-py-L32|“partial” mapping generator>