https://dagster.io/ logo
c

Chris Roth

04/14/2020, 8:45 PM
also, how do i get the raw log output to work? i'm currently using sqs/celery and seeing nothing when i view raw logs
p

prha

04/14/2020, 9:04 PM
Yes,
compute_log_manager
is wrong… we’ll update the docs to fix that, thanks for the report!
c

Chris Roth

04/14/2020, 9:04 PM
for sure! any idea why raw logs wouldn't be showing up?
p

prha

04/14/2020, 9:05 PM
are the workers running on a different box?
c

Chris Roth

04/14/2020, 9:05 PM
i think so actually yeah
trying to confirm which worker it's getting delegated to now
p

prha

04/14/2020, 9:05 PM
if so, you might want to switch to a different implementation, e.g.
S3ComputeLogManager
you won’t get to see the streaming logs, but upon step completion, the local logs will get uploaded to an S3 bucket of your choosing
c

Chris Roth

04/14/2020, 9:06 PM
ohhh duh, sorry my fault here - i think the changes just haven't been getting propagated to my workers
thank you. that makes a ton of sense
p

prha

04/14/2020, 9:06 PM
for sure… let me know if you run into anything else!
c

Chris Roth

04/14/2020, 9:06 PM
will do!