Hi Everyone, I’m facing this issue and it is happening to some random runs. And it is happening when the run is in queued state.

Dagster version 1.2.1

Caught an unrecoverable error while dequeuing the run. Marking the run as failed and dropping it from the queue
dagster._core.errors.DagsterLaunchFailedError: Tried to start a run on a server after telling it to shut down

Stack Trace:
  File "/home/ubuntu/apps/dagster-matching-service/venv/lib/python3.10/site-packages/dagster/_daemon/run_coordinator/queued_run_coordinator_daemon.py", line 335, in _dequeue_run
    instance.run_launcher.launch_run(LaunchRunContext(dagster_run=run, workspace=workspace))
,  File "/home/ubuntu/apps/dagster-matching-service/venv/lib/python3.10/site-packages/dagster/_core/launcher/default_run_launcher.py", line 121, in launch_run
    DefaultRunLauncher.launch_run_from_grpc_client(
,  File "/home/ubuntu/apps/dagster-matching-service/venv/lib/python3.10/site-packages/dagster/_core/launcher/default_run_launcher.py", line 89, in launch_run_from_grpc_client
    raise (

Not sure why it is happening.