Guy McCombe
04/21/2023, 2:07 PMdagster._core.errors.DagsterInvalidDefinitionError: Conflicting versions of resource with key 'airbyte' were provided to different assets. When constructing a job, all resource definitions provided to assets must match by reference equality for a given key.
ben
04/21/2023, 4:00 PMGuy McCombe
04/24/2023, 9:17 AMfoo_assets = load_assets_from_airbyte_instance(
airbyte,
connection_to_group_fn=lambda group_name: "foo",
key_prefix="foo",
connection_filter=lambda meta: "foo" in meta.name,
)
where airbyte=airbyte_resource.configured(AIRBYTE_CONFIG)
Jobs:
foo_replication = define_asset_job(
"foo_replication",
selection=AssetSelection.groups("foo"),
)
Schedules:
foo_schedule = ScheduleDefinition(
job=foo_replication,
cron_schedule="*/15 * * * *",
default_status=DefaultScheduleStatus.RUNNING,
)
We are using the definitions approach instead of a @repository
. LMK if you need to know any moreJoel Olazagasti
04/24/2023, 6:51 PMben
04/24/2023, 6:53 PMdagster-airbyte
to 1.2.6 should unblock this errorJoel Olazagasti
05/11/2023, 7:40 PMAirbyteResource
constructor instead of airbyte_resource.configured()
Guy McCombe
05/12/2023, 8:07 AM