Artem S

10/04/2022, 12:38 PM
Hi to everyone! Could somebody show a complete dagster configuration example to capture whole log messages, including dagster logs, third-party libs logs and also self-made code logs. I would like to send all logs to logstash, but i’m a bit confused what exactly i should do: implement dagster logger or add some settings to dagster.yaml or something else.
:dagster-bot-resolve: 1


10/04/2022, 8:22 PM
@owen - what would be your recommendation here?


10/04/2022, 8:31 PM
One option would be to add a handler that forwards messages from dagster to your dagster.yaml file like this: I'm not particularly familiar w/ logstash, but it looks like there are packages out there which provide logstash logging handlers (e.g. This handler will be used for any message that appears in the Dagster UI. By default, this does not include third-party library logs, but you can make third-party lib logs show up in the Dagster UI (and by extension, be processed by the logstash handler) by setting managed_python_loggers in your dagster.yaml (

Artem S

10/04/2022, 8:42 PM
Thanks a lot, will dig into
So, in this case isn’t necessary implement per-job loggers thru dagster logger decorator, and all dagster messages will handled thru logstash handler, right?
👍 1