https://dagster.io/ logo
Powered by
#announcements
Title
# announcements
c

Chris Roth

04/02/2020, 11:01 PM
hi, quick question. is it possible to use an environment variable in the 
celery_config.yaml
that is passed to 
dagster-celery
?
a

alex

04/02/2020, 11:05 PM
at least for broker and backend
c

Chris Roth

04/02/2020, 11:06 PM
awesome!
that's perfect timing haha
😄 1
a

alex

04/02/2020, 11:06 PM
plan is to go out today
c

Chris Roth

04/02/2020, 11:07 PM
nice!!
thank you as always for the amazing product and help 🙂
❤️ 3
@alex this didn't make it's way into 0.7.6 right?
a

alex

04/03/2020, 7:32 PM
should have
what are you seeing? are you doing
Copy code
broker:
  env: ENV_NAME
c

Chris Roth

04/03/2020, 7:33 PM
yeah
Copy code
execution:
  celery:
    broker:
      env: CELERY_BROKER
Copy code
worker_1  |     broker_url = '{'env': 'CELERY_BROKER'}'
worker_1  |                       ^
worker_1  | SyntaxError: invalid syntax
a

alex

04/03/2020, 7:44 PM
ah bollox the worker cli thing i didnt patch up
c

Chris Roth

04/03/2020, 7:44 PM
ah
no worries
a

alex

04/03/2020, 7:45 PM
what are you running exactly?
dagster-celrey worker start ?
c

Chris Roth

04/03/2020, 7:46 PM
yeah
["dagster-celery", "worker", "start", "-y", "celery.yaml"]
a

alex

04/03/2020, 11:17 PM
sorry got distracted - i think this is all thats needed https://dagster.phacility.com/D2439
c

Chris Roth

04/03/2020, 11:23 PM
nice!
related question - i'm using sqs with celery and it is creating a new queue for every run. is that expected behavior or something to do with celery?
a

alex

04/04/2020, 12:34 AM
cc @nate / @max that sounds off
m

max

04/04/2020, 1:07 AM
that does sound off, we haven't done (any?) testing with SQS so i am not sure how it behaves
3 Views
Powered by