Anupriya Kaushik

08/29/2022, 8:00 PM
Hi Team,, Can I connect to AWS SQS queue and read messages using Dagster? Do I need to use any kind of sensors to do that?


08/29/2022, 8:28 PM
Hi @Anupriya Kaushik this should be doable! we don't have built in support for SQS, but you can either connect directly in your ops/assets or write a resource https://docs.dagster.io/concepts/resources the source code for all of our AWS integrations can be found here https://github.com/dagster-io/dagster/tree/master/python_modules/libraries/dagster-aws/dagster_aws if you want to reference how we do authorization. the S3 resource would be a good one to reference https://github.com/dagster-io/dagster/blob/master/python_modules/libraries/dagster-aws/dagster_aws/s3/resources.py