https://dagster.io/ logo
b

Bob

01/07/2020, 4:20 PM
Hi all, I’m setting up dagster to manage a data pipeline to write to google cloud storage and google bigquery. Locally it runs but when I deploy it to a simple server I get the following error, any clue what could be causing this?
a

alex

01/07/2020, 4:31 PM
Hmm - it looks like there is an error happening during a different error situation
Ah! you hit a bug we have since fixed (but not pushed a release for) from this line https://github.com/dagster-io/dagster/blob/0.6.6/python_modules/libraries/dagster-ssh/dagster_ssh/solids.py#L84
To workaround you can * Install a nightly version of dagster-ssh https://pypi.org/project/dagster-ssh-nightly/ * Fork the dagster-ssh solid locally
b

Bob

01/08/2020, 8:31 AM
Hi Alex, thanks for your reply. I found that my issue was actually caused by setting an incorrect location of my google service account auth file. The error log unfortunately does not indicate or hint to this issue.
a

alex

01/08/2020, 3:46 PM
Just to clarify, once you are no longer hitting the
KeyError
, the real underlying error is not surfaced in a useful way? Can you share what you do end up seeing?
b

Bob

01/08/2020, 4:18 PM
The
KeyError
was caused by incorrect location of the google service account, once I fixed the location issue the pipeline ran as expected without errors. So real underlying error of the incorrect file location was not shown and
KeyError
showed instead
a

alex

01/08/2020, 4:45 PM
Ok thank you - that issue is already fixed in master so will be resolved in the next release
appreciate you following up