I've got another question mostly unrelated to my previous one. I'm interested in building a simpler dashboard that basically shows the status of a few selected solids for every run of a pipeline. I'm wondering what the best way to do that would be. I'm guessing I'll just have to decide up front what info I'll need and set up custom loggers to store that data for every run. But I see log data stored in

$DAGSTER_HOME

, and I'm wondering if there's either a relatively clean and robust way to query that data from that log data, or a REST API or something in dagit I can hit to periodically query the status of all the past and queued runs. Any advice on this would be great.

you can access everything stored via the

DagsterInstance

class. It is not thoroughly documented but you can look at the source here https://github.com/dagster-io/dagster/blob/master/python_modules/dagster/dagster/core/instance/__init__.py