The cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability.

dagster

image.png

I can see intermediate object's keys, how can I see intermedaite's values?

I'm not sure you can; given you seem to be using the default `in_memory` intermediate storage.

If you configure your pipeline's run_config to set `intermediate_storage: { filesystem: {}}` then the keys become filepaths.

That being said; since they are stored as binary pickle files; I'm unsure how you would see the values without some additional python scripting.

Dagster team - do I have this right?  Is there an easier way to view intermediate values (especially if using a memory backed store)?

Seems there is an issue about it <https://github.com/dagster-io/dagster/issues/2630>