https://dagster.io/ logo
#dagster-airbyte
Title
# dagster-airbyte
s

Semyon Komissarov

01/20/2023, 6:57 PM
Hello! I have a postgresql connection in airbyte with Incremental Sync - Deduped History mode. And I connect airbyte to dagster. I only see base tables, but don’t see _scd tables. E.g. I have table
user
in Postgresql. When airbyte syncs this table to DWH, it produces 2 tables -
user
,
user_scd
. But I don’t see second table in dagster interface. Maybe I can add those tables manually somehow?
b

ben

01/20/2023, 7:03 PM
Hi Semyon, these scd tables are something we don’t auto-generate yet. If you use
build_airbyte_assets
(https://docs.dagster.io/_apidocs/libraries/dagster-airbyte#dagster_airbyte.build_airbyte_assets), you should be able to specify the
scd
tables in the
normalization_tables
param
s

Semyon Komissarov

01/20/2023, 7:03 PM
@ben merci! I will try it!
4 Views