mrdavidlaing
08/08/2021, 9:09 AMs3_*_io_manager
After following the guide at https://github.com/dagster-io/dagster/tree/0.12.5/examples/deploy_ecs my pipeline kept failing with:
botocore.exceptions.ClientError: An error occurred (403) when calling the HeadBucket operation: Forbidden
I was able to fix this issue by adding the following set of role permissions to the daemon.x-aws-role
section of docker-compose.yml
- Effect: "Allow"
Action:
- "s3:ListBucket"
- "s3:GetBucketLocation"
Resource:
- "arn:aws:s3:::$BUCKETNAME"
- Effect: "Allow"
Action:
- "s3:GetObject"
- "s3:PutObject"
Resource:
- "arn:aws:s3:::$BUCKETNAME/*"
Is this the "correct" way to address this issue, or should I be doing something else?Josh Lloyd
08/09/2021, 1:21 PMjordan
08/09/2021, 2:04 PMmrdavidlaing
08/09/2021, 6:13 PM