Happy 2023 We ran into a weird ChildProcessCrashException wi

Question

Happy 2023 We ran into a weird ChildProcessCrashException with exit code 9 error for one job consistently I am wondering if anyone has seen this before

Hebo Yang · Answer

```Multiprocess executor child process for step run forecast xp cng conversion rate nc unexpectedly exited with code 9 dagster core executor child process executor ChildProcessCrashException Stack Trace File usr local lib python3 8 site packages dagster core executor multiprocess py line 210 in execute event or none = next step iter File usr local lib python3 8 site packages dagster core executor multiprocess py line 324 in execute step out of process for ret in execute child process command multiproc ctx command File usr local lib python3 8 site packages dagster core executor child process executor py line 163 in execute child process command raise ChildProcessCrashException exit code=process exitcode ```

Hebo Yang · Answer

```dagster core executor child process executor ChildProcessCrashException Stack Trace File usr local lib python3 8 site packages dagster core executor multiprocess py line 210 in execute event or none = next step iter File usr local lib python3 8 site packages dagster core executor multiprocess py line 324 in execute step out of process for ret in execute child process command multiproc ctx command File usr local lib python3 8 site packages dagster core executor child process executor py line 163 in execute child process command raise ChildProcessCrashException exit code=process exitcode dagster check CheckError Invariant failed Description Attempted to mark step run forecast xp cng conversion rate nc as complete that was not known to be in flight File usr local lib python3 8 site packages dagster core execution api py line 1033 in pipeline execution iterator for event in pipeline context executor execute pipeline context execution plan File usr local lib python3 8 site packages dagster core executor multiprocess py line 240 in execute active execution handle event step failure event File usr local lib python3 8 site packages dagster core execution plan active py line 400 in handle event self mark failed step key File usr local lib python3 8 site packages dagster core execution plan active py line 342 in mark failed self mark complete step key File usr local lib python3 8 site packages dagster core execution plan active py line 387 in mark complete check invariant File usr local lib python3 8 site packages dagster check init py line 1470 in invariant raise CheckError f Invariant failed Description desc ```

alex · Answer

exit code ` 9` means the process was killed via the `SIGKILL` signal likely by the `oom killer` which happens when the process tries to use too much memory

Hebo Yang · Answer

Thanks Alex