https://dagster.io/ logo
Title
h

Hebo Yang

09/30/2022, 8:48 PM
Hi team. getting an intermittent error with our repo. I checked the repo logs that there isn’t really any exception and it is logging ok. Its mem and CPU utilization are also fairly low. Wondering if you have some pointers on this error?
dagster._core.errors.DagsterUserCodeUnreachableError: Could not reach user code server
...
The above exception was caused by the following exception:
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "failed to connect to all addresses"
debug_error_string = "{"created":"@1664566364.715539913","description":"Failed to pick subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":3260,"referenced_errors":[{"created":"@1664566364.715539537","description":"failed to connect to all addresses","file":"src/core/lib/transport/error_utils.cc","file_line":167,"grpc_status":14}]}"
Full error
The above exception was caused by the following exception:
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "failed to connect to all addresses"
debug_error_string = "{"created":"@1664566364.715539913","description":"Failed to pick subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":3260,"referenced_errors":[{"created":"@1664566364.715539537","description":"failed to connect to all addresses","file":"src/core/lib/transport/error_utils.cc","file_line":167,"grpc_status":14}]}"
>

Stack Trace:
File "/usr/local/lib/python3.7/site-packages/dagster/_grpc/client.py", line 122, in _streaming_query
yield from response_stream
File "/usr/local/lib/python3.7/site-packages/grpc/_channel.py", line 426, in __next__
return self._next()
File "/usr/local/lib/python3.7/site-packages/grpc/_channel.py", line 826, in _next
raise self

  File "/usr/local/lib/python3.7/site-packages/dagster_graphql/implementation/utils.py", line 68, in _fn
    return fn(*args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/dagster_graphql/implementation/fetch_runs.py", line 384, in validate_pipeline_config
    external_pipeline = get_external_pipeline_or_raise(graphene_info, selector)
  File "/usr/local/lib/python3.7/site-packages/dagster_graphql/implementation/external.py", line 30, in get_external_pipeline_or_raise
    full_pipeline = get_full_external_pipeline_or_raise(graphene_info, selector)
  File "/usr/local/lib/python3.7/site-packages/dagster_graphql/implementation/external.py", line 20, in get_full_external_pipeline_or_raise
    if not graphene_info.context.has_external_pipeline(selector):
  File "/usr/local/lib/python3.7/site-packages/dagster/_core/workspace/context.py", line 175, in has_external_pipeline
    loc = self.get_repository_location(selector.location_name)
  File "/usr/local/lib/python3.7/site-packages/dagster/_core/workspace/context.py", line 118, in get_repository_location
    load_error_infos=[error_info],
d

daniel

10/03/2022, 2:33 PM
Hey Hebo - if you look in the Workspace tab does the location show up as in an error state? It looks like that stack trace might be truncated (and just very long) do you possibly have the un-truncated version/