Hi I am running into an unexpected error using dagster serve

Question

Hi I am running into an unexpected error using dagster serverless ```Multiprocess executor child process for step historical fire perimeters geojson unexpectedly exited with code 9 dagster core executor child process executor ChildProcessCrashException```

David Merritt · Answer

It seems to occur after a successful yield of an `op` result in a job halting the flow of the job

David Merritt · Answer

cc < Gabe Schine> trying out your branch

jordan · Answer

Generally that s an out of memory error You might be launching the run in non isolated mode meaning it s sharing resources with some of your other processes Switching to isolated mode might help get around this

jordan · Answer

David Merritt · Answer

hmm let me try that but it seems like the isolated run takes 3+ minutes extra to start

David Merritt · Answer

Any idea why that would happen after a successful yield on an op I wouldn t expect gt 1gB of memory usage in that op It s downloading parsing some json but its not THAT much data

Gabe Schine · Answer

I think it s on the order of 50mB IIRC

David Merritt · Answer

```They have fewer compute resources 0 25 vCPU cores and 1GB of RAM These resources are shared with other processes for a code location like sensors As a result it s recommended to use isolated runs for compute intensive jobs and asset materializations ```

David Merritt · Answer

50mB of json < Gabe Schine> even if that doubles when parsed into the FS model we re well under gB but I m not sure the basic overhead of the dagit runner baseline level

David Merritt · Answer

isolated run did fix the issue thanks < jordan>

Gabe Schine · Answer

Yes 50mB of uncompressed JSON string

David Merritt · Answer

looks like ~1minute of spin up time I think that s acceptable Looks like this won t be an issue for scheduled jobs < Gabe Schine> ```When launching runs manually select Isolate run environment in the Launchpad to launch an isolated runs Scheduled sensor and backfill runs are always isolated ```

Gabe Schine · Answer

yep my read of the docs as well does the UI let you do a manual asset materialization but isolate its job

David Merritt · Answer

yes checkbox in the materialization config modal