Hello 😄 I was wondering if there has been any discussions or plans around tools that enable memory inspection of solids? Or is something like this outside the scope of dagster and dagit development? I really like the runtime details I get when running my pipeline with dagit, and I feel like details on memory usage would be helpful when debugging. For now, I'm using a combination of
in my solids to get a better understanding of their memory consumption
06/11/2020, 7:46 PM
Hi @Joseph Sayad, we haven’t formally considered adding this into dagster but agree that it sounds potentially interesting!
would you be able to create a ticket via github issues with some details about your use case?
06/12/2020, 2:23 PM
Yeah definitely! I'll create a ticket via github issue soon and share the link here afterwards