Hi all 👋🏼 Anyone have experiences to share regarding benchmarking pipeline / solid run durations over time, and under different execution scenarios? E.g. sending through 1 item vs 10k items; 1 running pipeline on the system vs 5 running simultaneously; day 1 of the project vs day 30, etc. I know a lot of good per-run metrics are available via the API, but to get those trends and comparisons we think we'll need to aggregate in a separate system. Interested what other folks are doing for this 🙂

this isn’t exactly what you’re asking for, but one thing that currently exists in dagit is the ability to view solid execution time iff that solid yields an asset materialization. looks like below: (cc @dish for ui product idea)

That looks cool! Thanks cat.