https://dagster.io/ logo
#ask-community
Title
# ask-community
g

George Pearse

01/13/2022, 1:20 PM
I hit this exception
Copy code
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "<https://behold-pipelines.s3.eu-west-2.amazonaws.com/?list-type=2&prefix=dagster%2Fstorage%2Fb42b4c9c-b930-4f6d-8a1e-58ea43d01361%2Ffetch_instances_info%5B12%5D%2Fresult&encoding-type=url>"
  File "/usr/local/lib/python3.7/site-packages/dagster/core/execution/plan/execute_plan.py", line 193, in _dagster_event_sequence_for_step
    for step_event in check.generator(step_events):
  File "/usr/local/lib/python3.7/site-packages/dagster/core/execution/plan/execute_step.py", line 326, in core_dagster_event_sequence_for_step
    for evt in _type_check_and_store_output(step_context, user_event, input_lineage):
  File "/usr/local/lib/python3.7/site-packages/dagster/core/execution/plan/execute_step.py", line 380, in _type_check_and_store_output
    for evt in _store_output(step_context, step_output_handle, output, input_lineage):
  File "/usr/local/lib/python3.7/site-packages/dagster/core/execution/plan/execute_step.py", line 488, in _store_output
    handle_output_res = output_manager.handle_output(output_context, output.value)
  File "/usr/local/lib/python3.7/site-packages/dagster_aws/s3/io_manager.py", line 68, in handle_output
    if self._has_object(key):
  File "/usr/local/lib/python3.7/site-packages/dagster_aws/s3/io_manager.py", line 50, in _has_object
    key_count = self.s3.list_objects_v2(Bucket=self.bucket, Prefix=key)["KeyCount"]
  File "/usr/local/lib/python3.7/site-packages/botocore/client.py", line 386, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.7/site-packages/botocore/client.py", line 692, in _make_api_call
    operation_model, request_dict, request_context)
  File "/usr/local/lib/python3.7/site-packages/botocore/client.py", line 711, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.7/site-packages/botocore/endpoint.py", line 102, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.7/site-packages/botocore/endpoint.py", line 156, in _send_request
    raise exception
  File "/usr/local/lib/python3.7/site-packages/botocore/endpoint.py", line 200, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.7/site-packages/botocore/endpoint.py", line 269, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.7/site-packages/botocore/httpsession.py", line 352, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
I'm assuming the connection to S3 was lost temporarily, I was going to add RetryRequested within the op but because this S3 load is handled by the io_manager I don't think that would increase the robustness at all. How could I make the io_manager try again for this op?