Mathew Lee

12/20/2021, 3:12 PM
Hey all! is there an easy way to view the intermediate output between steps without yielding an asset or writing to a csv (for local dev)? For example, if I wanted to read a dataframe, drop the cols, process the df, etc. (See screenshot) for example, if I wanted to view the data coming in as a dataframe could I do it from the UI (to keep everything in one place)? I did a quick look through Slack/Google/Docs and couldn't seem to find an easy way to do this :/

Mikhail Knyazev

12/20/2021, 4:32 PM
If "without yielding an asset" is not a strong requirement, you can try to use pandas' to_markdown and yield
with `` event (you don't have to actually persist dataframe anywhere)


12/20/2021, 4:52 PM
hi @Mathew Lee -- another option to the above suggestion would be to attach that same metadata entry to the output. So instead of just returning the output dataframe, you could
yield Output(df, metadata={"data":<|>_markdown())})
. This metadata will show up in the event log attached to the output. Docs here: