Hi! I'm trying to configure the celery-executor wi...
# announcements
c
Hi! I'm trying to configure the celery-executor with Amazon SQS but it seems that celery does not have support for a results backend with sqs. Does this mean the backend is not necessary? could someone point me to a configuration that might work with dagster-celery and sqs?
m
you will need to use a system other than SQS for the results backend -- i suspect your best bet in this case is a database
c
Thanks for the reply, so I can use sqs for the broker, and use another thing for the results? Also, is it possible to specify queues per pipeline? I tried with predetermined queues but this seems to fail. Using SQS, a new queue is created per run.