https://dagster.io/ logo
#integration-bigquery
Title
# integration-bigquery
d

Donny Ho

07/11/2023, 1:31 PM
I just trying to get the example project working for GCP bigquery with the serverless option. It seems to be pretty straight forward but I get this issue. Is this due to me not setting the
GOOGLE_AUTH_CREDENTIALS
correctly? I have tried to do this in 2 ways: 1. Copy pasted in the JSON file content into the field when you start an example project 2. used
cat path/to/downloaded/json.key | base64
the base64 output in the variable Here is the repo that was automatically created, i haven't changed anything
🌈 1
j

jamie

07/11/2023, 4:11 PM
hey @Donny Ho for serverless you’ll want to set the
cat path/to/downloaded/json.key | base64
as the
gcp_credentials
configuration value for the bigquery io manager. the process is described here, but let me know if you have any questions!
d

Donny Ho

07/12/2023, 5:11 PM
Hmm still getting this error though, I tried with both upper and lower case for
gcp_credentials
j

jamie

07/12/2023, 5:13 PM
just to confirm, you’re also passing those credentials to the BigQuery IO manager?
Copy code
defs = Definitions(
   assets=[...],
   resources={
      "bigquery": BigQueryPandasIOManager(
           gcp_credentials=EnvVar("GCP_CREDENTIALS")
       )
   }
)
3 Views