Hello 😄 I was wondering if there has been any discussions or plans around tools that enable memory inspection of solids? Or is something like this outside the scope of dagster and dagit development? I really like the runtime details I get when running my pipeline with dagit, and I feel like details on memory usage would be helpful when debugging. For now, I'm using a combination of

tracemalloc

and

memory_profiler

in my solids to get a better understanding of their memory consumption

Hi @Joseph Sayad, we haven’t formally considered adding this into dagster but agree that it sounds potentially interesting!

Yeah definitely! I'll create a ticket via github issue soon and share the link here afterwards