More of a query around functionality, than a support request: I'm using Asset Materialisations in each solid and have a single pipeline moving my data from ingestion, through different stages of the data environment. I was thinking to maintain a sense of lineage between assets across a pipeline, I would use

EventMetadata.asset(...)

to link them, but it doesn't seem to work as the asset from previous solids isn't available for subsequent solid executions. Am I correct in saying the assets is only available for referencing once the pipeline execution has finished?

metadata={
    "source_asset": EventMetadata.asset(AssetKey(["foo-bar","hello-world"])),
    ...
}

gives

dagster.core.errors.DagsterInvalidEventMetadata: Could not resolve the metadata value for "source_asset" to a known type. Consider wrapping the value with the appropriate EventMetadata type.

It seems to be a bug. Both

DagsterAssetMetadataEntryData

and

DagsterPipelineRunMetadataEntryData

(which are part of the EntryDataUnion) are missing from this line. Adding

DagsterAssetMetadataEntryData

seems to fix your error.

Amazing

Didn't see your message, I just created a PR as well 😅 https://github.com/dagster-io/dagster/issues/4613 https://github.com/dagster-io/dagster/pull/4615

oh yours is more comprehensive than mine, I'll close mine

You're welcome!