I am confused by ExpectationResult. Does logging an ExpectionResult do anything other than add it to the logs? Is this just for manual human observation when looking at an individual run? I was expecting it to be more useful. Like making plots available of the results over time? Or failing an asset when an ExpectionResult is negative?
Nathan Skone
04/13/2023, 9:41 PM
For context I am currently trying to use this within assets, not ops
Nathan Skone
04/13/2023, 9:43 PM
I was hoping for a tool that could help us send alerts to our data analysts when data expectations are not yet. Ideally with two levels: warning (continue job, send alert) and error (stop job send alert)
Nathan Skone
04/13/2023, 9:45 PM
Perhaps I should be using GreatExpectations instead, but the docs for using it within Dagster are op based, not asset based.
c
claire
04/13/2023, 11:16 PM
Hi Nathan. To my knowledge the current functionality of expectation results is just to display them in the logs. We are considering augmenting this functionality though for assets: https://github.com/dagster-io/dagster/discussions/9543
claire
04/13/2023, 11:17 PM
Please feel free to comment with any thoughts or feedback on the thread
n
Nathan Skone
04/14/2023, 6:10 AM
@claire Thank you for the response. I will give that thread some thought and provide some feedback. Thanks!