https://dagster.io/ logo
Title
g

Guy McCombe

04/21/2023, 2:07 PM
Anyone else get this when upgrading to 1.3? Any ideas?
dagster._core.errors.DagsterInvalidDefinitionError: Conflicting versions of resource with key 'airbyte' were provided to different assets. When constructing a job, all resource definitions provided to assets must match by reference equality for a given key.
I’m using load_assets_from_airbyte_instance fwiw
b

ben

04/21/2023, 4:00 PM
Hi Guy, could you try updating to 1.3.1? This looks like a bug we identified in the initial 1.3 release
g

Guy McCombe

04/24/2023, 9:17 AM
Looks like the same issue on 1.3.1. For reference: Assets are defined:
foo_assets = load_assets_from_airbyte_instance(
    airbyte,
    connection_to_group_fn=lambda group_name: "foo",
    key_prefix="foo",
    connection_filter=lambda meta: "foo" in meta.name,
)
where
airbyte=airbyte_resource.configured(AIRBYTE_CONFIG)
Jobs:
foo_replication = define_asset_job(
    "foo_replication",
    selection=AssetSelection.groups("foo"),
)
Schedules:
foo_schedule = ScheduleDefinition(
    job=foo_replication,
    cron_schedule="*/15 * * * *",
    default_status=DefaultScheduleStatus.RUNNING,
)
We are using the definitions approach instead of a
@repository
. LMK if you need to know any more
j

Joel Olazagasti

04/24/2023, 6:51 PM
I'm experiencing the same issue here. Also willing to provide assistance if necessary
b

ben

04/24/2023, 6:53 PM
Sorry to hear this is still an issue in 1.3.1 - let me try to replicate, I think this is a slightly more complex case of what we patched so it may not have been fixed
For now I believe downgrading to
dagster-airbyte
to 1.2.6 should unblock this error
:plus1: 1
j

Joel Olazagasti

05/11/2023, 7:40 PM
@Guy McCombe A change I made that was just released in 1.3.4 fixes this issue if you use the
AirbyteResource
constructor instead of
airbyte_resource.configured()
:daggy-success: 1
g

Guy McCombe

05/12/2023, 8:07 AM
Thanks, @Joel Olazagasti - I’ll give it a try