Josh Taylor
12/01/2021, 8:35 AMimport pydevd_pycharm
pydevd_pycharm.settrace('localhost', port=33322, stdoutToServer=True, stderrToServer=True, suspend=False)
I've tried the other options such as patch_multiprocessing=True but it doesn't work.
This use to work, but I think ops/jobs changes things with this:
2021-12-01 16:33:03 - dagster - DEBUG - my_awesome_pipeline - 2fb31964-e61b-4d48-b1da-879f468cd49c - 7441 - RUN_START - Started execution of run for "my_awesome_pipeline".
2021-12-01 16:33:03 - dagster - DEBUG - my_awesome_pipeline - 2fb31964-e61b-4d48-b1da-879f468cd49c - 7441 - ENGINE_EVENT - Executing steps using multiprocess executor: parent process (pid: 7441)
2021-12-01 16:33:03 - dagster - DEBUG - my_awesome_pipeline - 2fb31964-e61b-4d48-b1da-879f468cd49c - 7441 - awesome_op - ENGINE_EVENT - Launching subprocess for awesome_op
where it then freezes when in debug mode.
edit;
By adding
```executor_def=in_process_executor,
To my job it fixed it, as it now runs in a single process.