Here's a screen recording of the improvements to the dagit execution viewer.
Note:
- The "preparing" pare of step execution, so that you know when steps are starting up, booting processes, containers, pods, spark contexts and like.
- Those events (process starts and resource spinup in this example) are captured and displayed in the timeline view.
- You can mouse over log entries and see where in the timeline they occur.
Amazing frontend engineering from @Ben Gotow as always! Thanks Ben.