Hiya, a question for the channel - how do you use Dagster for data ingestion with Snowflake? Do you combine it with pipes/streams, or use Dagster standalone for data ingestion?
o
Odette Harary
08/29/2023, 5:43 PM
Hi Harkanwal - We see a lot of different patterns across our users, one of them with Snowflake is having a snowflake resource from
dagster_snowflake
and using dagster to orchestrate the queries
h
Harkanwal Singh
08/29/2023, 8:32 PM
Thanks @Odette Harary - so basically, using pipes and streams but with
dagster_snowflake
as Snowflake resource?
f
Félix Tremblay
09/01/2023, 1:23 AM
We are using a Snowflake Resource and uploading dataframes directly to Snowflake with inserts