Hi all, I am running an OP which ingests data from...
# ask-community
z
Hi all, I am running an OP which ingests data from Oracle to Postgres. There is nothing fancy just standard ingestion, and I am getting child process crash exception error. Could it be related to the allocated docker memory ? as its mentioned here https://stackoverflow.com/questions/70243762/childprocesscrashexception-in-dagster-multiprocess-execution-in-multi-container
Copy code
dagster._core.executor.child_process_executor.ChildProcessCrashException

Stack Trace:
  File "/usr/local/lib/python3.9/site-packages/dagster/_core/executor/multiprocess.py", line 210, in execute
    event_or_none = next(step_iter)
,  File "/usr/local/lib/python3.9/site-packages/dagster/_core/executor/multiprocess.py", line 324, in execute_step_out_of_process
    for ret in execute_child_process_command(multiproc_ctx, command):
,  File "/usr/local/lib/python3.9/site-packages/dagster/_core/executor/child_process_executor.py", line 163, in execute_child_process_command
    raise ChildProcessCrashException(exit_code=process.exitcode)
z
this error seems to usually be associated with an out of memory error - I'd try upping the memory constraints and re-running the job.
i
yeah, try increasing your RAM and monitoring the RAM consumption on docker dashboard so you can see why it's happening