Benoit Fayolle

01/27/2023, 11:24 AM
Hello I'm trying to make a 2 asset graph work where given a dbt model in my redshift cluster that I materialize as an asset, I want to use a downstream asset to output this dbt model to google drive. I successfully created my asset in redshift and materialized it. When I run the downstream asset though, I'm getting the following error:
FileNotFoundError: [Errno 2] No such file or directory: '/opt/dagster/dagster_home/storage/gdrive_dw/gdrive'
is my key_prefix and
is the upstream asset. Should I define a specific IO manager to be able to pull the data from redshift and parse it as a pandas dataframe? I'm using the latest dagster version.
:dagster-bot-resolve: 1
Managed to answer my own question. Yes I needed to create a custom IO Manager for extract from redshift and output as pandas dataframe
👍 2