https://dagster.io/ logo
#ask-community
Title
# ask-community
m

Mathieu Grosso

08/28/2023, 9:02 AM
hello everyone : Here is my use-case. We have dagster running and we get files each day through API. Is it a good practice to use dagster with dbt to get the files, drop them into bigquery and then using dbt to put the data in our SQL database (that we use for production in application) Or is dagster enough to just load it directly to sql ? Thanks
t

Tim Castillo

08/29/2023, 3:46 PM
dbt isn't an ingestion tool, so you might hit some difficulties trying to use it as one. Dagster can absolutely fetch your files and ingest them into bigquery. Then Dagster can orchestrate your dbt runs to transform that day within the warehouse. If you need to export the data elsewhere, then since Dagster is just Python, you can extract the data out of BQ and into your destination.