Does Dagster publish OpenTelemetry tracing events?...
# dagster-plus
g
Does Dagster publish OpenTelemetry tracing events? We have an otel-collector in our k8s cluster (hybrid user here) and I'd like to send the traces for runs there if possible. Also, to have log lines emit trace and span-id so they can be correlated to the traces.
j
Dagster doesn’t currently. But if you want to open an issue on the Github repo, it’s something we can prioritize against other feature requests.
m
And I recently released a library (just OSS, unaffiliated w/ Dagster) which hooks up trace propagation for Dagster ops: https://github.com/Form-Energy/formenergy-observability .
I think this existing ticket may be looking for your upvote: https://github.com/dagster-io/dagster/issues/11191 .
m
Thanks, I was looking at that linked from the ticket. It definitely has some overlap with what I've been doing, for example in https://github.com/Form-Energy/formenergy-observability/blob/main/form_observability/dagster_otel/otel_ops.py#L170 which starts a span for each
@op
.
g
Good stuff