Docs
Join the conversation
Join Slack
Channels
announcements
dagster-airbyte
dagster-airflow
dagster-bigquery
dagster-cloud
dagster-cube
dagster-dask
dagster-dbt
dagster-de
dagster-ecs
dagster-feedback
dagster-kubernetes
dagster-noteable
dagster-releases
dagster-serverless
dagster-showcase
dagster-snowflake
dagster-support
dagster-wandb
dagstereo
data-platform-design
events
faq-read-me-before-posting
gigs-freelance
github-discussions
introductions
jobs
random
tools
豆瓣酱帮
Powered by Linen
Title
a
Anupriya Kaushik
08/29/2022, 8:00 PM
Hi Team,, Can I connect to AWS SQS queue and read messages using Dagster? Do I need to use any kind of sensors to do that?
j
jamie
08/29/2022, 8:28 PM
Hi
@Anupriya Kaushik
this should be doable! we don't have built in support for SQS, but you can either connect directly in your ops/assets or write a resource
https://docs.dagster.io/concepts/resources
the source code for all of our AWS integrations can be found here
https://github.com/dagster-io/dagster/tree/master/python_modules/libraries/dagster-aws/dagster_aws
if you want to reference how we do authorization. the S3 resource would be a good one to reference
https://github.com/dagster-io/dagster/blob/master/python_modules/libraries/dagster-aws/dagster_aws/s3/resources.py