https://dagster.io/ logo
d

dwall

02/11/2020, 8:01 PM
we are consistently getting the following error when running a pipeline in a docker container. Have y'all seen something like this before?:
Copy code
An exception was thrown during execution that is likely a framework error, rather than an error in user code.
Original error message: Exception: Pipeline execution process for f8960a24-22b1-4149-96d7-806be3f228d2 unexpectedly exited

Stack Trace:
  File "/home/docker/.local/share/virtualenvs/app-4PlAip0Q/lib/python3.8/site-packages/dagster_graphql/implementation/pipeline_execution_manager.py", line 212, in _generate_synthetic_error_from_crash
    raise Exception(
seems to only happen through Dagit btw
s

schrockn

02/11/2020, 8:06 PM
do you see any further error text in the terminal?
or stderr generally
d

dwall

02/11/2020, 8:06 PM
nope - this specific message seems to only appear within Dagit UI
s

schrockn

02/11/2020, 8:09 PM
at a minimum those messages should be replicated in stderr
d

dwall

02/11/2020, 8:09 PM
I'll see if Im missing something. First glance didnt look like they were there
Think it has to do with multiprocess execution. Turned it off and things seem fine now
s

schrockn

02/11/2020, 8:22 PM
so this is multiprocess within a docker container
d

dwall

02/11/2020, 8:28 PM
Yes
m

max

02/11/2020, 8:39 PM
are you on 0.6.9?
d

dwall

02/11/2020, 8:42 PM
yep!
only odd thing with our deployment that I can think of is that we had to apply this workaround since we are deploying on linux: https://dagster.slack.com/archives/CCCR6P2UR/p1581005811125000?thread_ts=1580953874.119100&cid=CCCR6P2UR
a

alex

02/11/2020, 10:50 PM
how exactly were you running in the docker container? it seems some process exited unexpectedly but without any logs its hard to know what could be the issue