Hi to everyone! Could somebody show a complete dagster configuration example to capture whole log messages, including dagster logs, third-party libs logs and also self-made code logs. I would like to send all logs to logstash, but i’m a bit confused what exactly i should do: implement dagster logger or add some settings to dagster.yaml or something else.

@owen - what would be your recommendation here?

One option would be to add a handler that forwards messages from dagster to your dagster.yaml file like this: https://docs.dagster.io/concepts/logging/python-logging#configuring-python-log-handlers-. I'm not particularly familiar w/ logstash, but it looks like there are packages out there which provide logstash logging handlers (e.g. https://pypi.org/project/python-logstash-async/) This handler will be used for any message that appears in the Dagster UI. By default, this does not include third-party library logs, but you can make third-party lib logs show up in the Dagster UI (and by extension, be processed by the logstash handler) by setting managed_python_loggers in your dagster.yaml (https://docs.dagster.io/concepts/logging/python-logging#capturing-python-logs-).

Thanks a lot, will dig into