19913d85-f662-4518-a9a1-7adc1793dfd4.png){kind=small}
Hey! First of all: great work on the dbt integrati...
# integration-dbtp
Pieter Custers
09/04/2023, 11:54 AMHey! First of all: great work on the dbt integration in 1.4, really loving it!
We figured that we rely on the stdout/stderr logs now when using DbtCli and are configuring a compute log manager now as the logs do not show up anymore as structured event logs. I did find some threads and documentation but it is not clear to me if you plan to add the dbt logs to the structured event logs again in the future?
Thanks in advance!
❤️ 1
🤖 1
Pieter Custers
09/04/2023, 2:00 PMIf not, we need a custom solution here as within our company we already store our logs in Loki and it is undesirable to have a third log location configured (next to Loki and Dagster Postgres). I wouldn’t immediately know how to start connecting Loki through a CustomComputeLogManager. First: do you think it is possible? If so, do you have some example boiler plate code on how to get started with a custom compute log manager in general? It is not clear to me how the server should expose the logs exactly.
Pieter Custers
09/04/2023, 2:02 PMOur alerting relies atm on the structured logs. I really hope you plan on getting the dbt logs in there again
r
rex
09/04/2023, 4:02 PMHere's a thread on this: https://dagster.slack.com/archives/C04CW71AGBW/p1690162823644269
And corresponding solution: https://github.com/dagster-io/dagster/issues/15479#issuecomment-1647106801
p
Pieter Custers
09/05/2023, 4:38 PMThanks @rex !
3 Views