Hey guys,
Databricks question here:
is it possible/ does it make sense to execute an op within a Databricks context on a cluster and transform it somehow into an asset and make it visible in dagit?
Basically right now, we’re only triggering runs for already deployed Databricks jobs with Dagster that store data on S3, without all the asset benefits.
Do you have any experiences with that setup?