Hi, dagster team! Is there a way to possibly connect an asset with an op? I have generated an asset that reads a csv file from s3 and I want to use greatexpectations (dagster-ge) op to test this one out. Thanks 🙂

One idea would be to model the

dagster-ge

op as a graph-backed asset, with the results of the QC checks being your asset. Then the GreatExpectations asset graph could depend on the asset you want to QC. Another idea (might be a little more of a hack) that I personally haven't tried before would be to use the new `root_input_manager` abstraction to load the asset by just embedding the same logic the upstream asset's IOManager uses to load the asset's value. This wouldn't be recognized as a dependency between the op and the asset by Dagster, which may or may not be what you want (the graph-backed asset approach would show your

dagster-ge

asset as stale every time you materialized the upstream, which may or may not be what you want). Other than that I don't think there's a Dagster-native way to load an asset from an op, but I think it's a feature that's on the Dagster team's radar as it comes up pretty regularly.

A variant on Zach's second suggestion that might be a little easier is this capability that we recently added: https://docs.dagster.io/guides/dagster/how-assets-relate-to-ops-and-graphs#op-graphs-that-read-from-an-asset

Hey Zach, Sandy, thank you so much for your inputs. After quite a lot of internalization, I just converted the dagster-ge op into an asset using

AssetsDefinition.from_op

. I'll see if this will work 🙂

I am trying something similar, but I did try and incorporate a ge op made with get_validation_op_factory in a graph_asset as Sandy suggested. However when the op is executed it looks like it is erroring out because resource_defs does not have ge_data_context defined. Which is true because I haven't figured out how to pass resource_defs into the asset job definition which calls the graph_asset. Am I missing something key to get the ge_op to work?