https://dagster.io/ logo
Title
g

Greg Burd

02/15/2023, 3:21 PM
Does Dagster publish OpenTelemetry tracing events? We have an otel-collector in our k8s cluster (hybrid user here) and I'd like to send the traces for runs there if possible. Also, to have log lines emit trace and span-id so they can be correlated to the traces.
j

jordan

02/15/2023, 3:26 PM
Dagster doesn’t currently. But if you want to open an issue on the Github repo, it’s something we can prioritize against other feature requests.
m

Mark Fickett

02/15/2023, 3:31 PM
And I recently released a library (just OSS, unaffiliated w/ Dagster) which hooks up trace propagation for Dagster ops: https://github.com/Form-Energy/formenergy-observability .
I think this existing ticket may be looking for your upvote: https://github.com/dagster-io/dagster/issues/11191 .
m

Mark Fickett

02/15/2023, 3:56 PM
Thanks, I was looking at that linked from the ticket. It definitely has some overlap with what I've been doing, for example in https://github.com/Form-Energy/formenergy-observability/blob/main/form_observability/dagster_otel/otel_ops.py#L170 which starts a span for each
@op
.
g

Greg Burd

02/15/2023, 3:59 PM
Good stuff