https://dagster.io/ logo
Title
j

Jonathan Neo

01/14/2023, 5:33 AM
Hey folks, does anyone know of a way I can get a list of asset keys from my airbyte assets
airbyte_assets = load_assets_from_connections(...)
? I would like to pass the asset keys into a asset job definition. For example:
airbyte_assets = load_assets_from_connections(...) 

# do something to get airbyte_asset keys 
MY_ASSET_KEYS = airbyte_assets.do_something_to_get_keys() 

my_job = define_asset_job(name="my_job", selection=AssetSelection.keys( MY_ASSET_KEYS ))
b

ben

01/20/2023, 7:00 PM
Hi Jonathan, the resolution of the asset keys in this case is deferred until the Dagster repository loads, because Airbyte’s APIs need to be queried to get the list of connections. Would selecting assets by group name suffice in this case?