I am trying to use build airbyte assets when the connection

Question

I am trying to use build airbyte assets when the connection is only moving csv files to the destination The official example describe a scenario of postgre to postgres and is using the option destination tables How should be use when is only moving csv files

Saul Burgos · Answer

Answer my own question According to doc an asset is used only when you know what those assets will be before to launch any runs In my case the airbyte connection will be pulling CSV from a SFTP and maybe there are more files o not For that reason I should not use build airbyte assets instead I should use it like an operation described in this example <https docs airbyte com operator guides using dagster integration creating a simple dagster dag to run an airbyte sync job>