https://dagster.io/ logo
Title
s

Simon

11/15/2022, 6:00 PM
Ola! Does anyone know if there's a way to get an overview of all failed (and maybe also missing) partitions for all Assets in one place? I've not been able to find one.
c

claire

11/15/2022, 7:08 PM
Hi Simon, unfortunately, we don't currently have a global view of failed/missing partitions. We only have per-asset views located in the asset details page and on the job partitions tab in Dagit. We are hoping to add a view similar to this though in the future
s

Simon

11/15/2022, 7:17 PM
Hi @claire! Thanks for the answer/info. Do you know if there's any issue/feature request for this I could follow? I couldn't find one in the repo, but might've used the wrong terms. For context: We're migrating from Airflow to Dagster and this overview is pretty much the only "big" thing we're missing. It's pretty difficult to making sure there are no failures/failed partitions for Assets. The Run overview doesn't work for this since the old failed Runs are kept as well (which makes sense given they are all just independent Runs), but that means it's impossible to get a current view of everything.
c

claire

11/15/2022, 9:19 PM
This issue is probably the most similar one to your request: https://github.com/dagster-io/dagster/issues/10157 If you have specific thoughts on areas of improvement (like enabling a view across all asset partitions), feel free to chime in on the issue!
s

Simon

11/15/2022, 10:28 PM
@claire Thanks! Was already keeping an eye on that one, contains a bunch of good improvements. Will subscribe to it to follow any updates. Will have a look if maybe we can contribute to some of it as well
:rainbow-daggy: 1
y

Yeachan Park

01/17/2023, 3:39 PM
Hi @claire, was wondering if there's an update with regards to this?