https://dagster.io/ logo
#ask-community
Title
# ask-community
a

Aaron T

06/05/2023, 5:57 PM
I want to pass a custom
aws_access_key_id
and
aws_secret_access_key
to my
s3_resource
, but I want to keep multiple s3 resources with different access keys and credentials and endpoints. How can I go about doing that? I initially thought create my own resource, but then it looks like the s3_resource can achieve this, I am just not sure how to go about it
s

sandy

06/05/2023, 7:24 PM
What do you want to do with the different resources? Use them in different assets?
a

Aaron T

06/05/2023, 7:40 PM
Hey @sandy I want to have my default IO manager pointing to minio, but we also need an aws s3 io manager for some of my sensors. So, I can't just update my environment variables since I will need to access multiple s3 storage locations with different credentials. Right now, I am currently trying to make a custom
io_manager
that uses a
custom_s3
resource, which I am defining as
s3Resource(...)
and passing in the endpoint, key and secret
Got it working. Essentially I create individual `S3Resource`'s and then just need an
io_manager
that will use that specified resource key
s

sandy

06/05/2023, 8:00 PM
great
22 Views