The cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability.

dagster

I also catch ```ClientError: An error occurred (403) when calling the HeadObject operation: Forbidden``` when I try to download a file from private bucket, I have creds in environment as usual. I can download it manually via ```import boto3
s3 = boto3.resource("s3")
s3.Bucket(bucket_name).download_file``` though

Public files work ok, how should I actually setup creds then?

yep, if I create my own resource ```
@resource
def mys3(_):
    return boto3.resource("s3")``` everything is fine

what approach did you take that was not working?

<@UH3RM70A2> like in airline_demo, dagster_aws, identical but private bucket

interesting - heres where we create the s3 session <https://github.com/dagster-io/dagster/blob/master/python_modules/libraries/dagster-aws/dagster_aws/s3/utils.py#L5-L9>

<@UDJ0NL1LY> any idea why this wouldn't work for private Buckets?

hmm, i think the session will have to be signed for a private bucket

yep, we should probably switch the default config value for the resource

<@UNESBRG2W> if you use the `dagster_aws.s3.s3_resource`, you should be good if you set the config value `use_unsigned_session: false`