Saul Burgos

08/03/2022, 4:11 PM
I am trying to use "build_airbyte_assets" when the connection is only moving csv files to the destination. The official example describe a scenario of postgre to postgres and is using the option "destination_tables" How should be use when is only moving csv files?
Answer my own question: According to doc, an asset is used only when: "you know what those assets will be before to launch any runs" In my case the airbyte connection will be pulling CSV from a SFTP and maybe there are more files o not. For that reason I should not use "build_airbyte_assets", instead I should use it like an operation described in this example: