Here is a brief summary for question 1. Say we have a large (~15GB) excel file we want to load into a SQL database. In the Dagster documentation under the section "Multiple and Conditional outputs" it describes how a single solid could have multiple outputs. My first thought is to create a solid that would read the excel file and yield each chunk. Each chunk would be fed into another solid that would insert it into the database. However, the documentation specifies particular outputs and names them for the solid with multiple outputs ("hot_cereals", "cold_cereals"). Is there a way for a solid to have multiple outputs that are not named ?

As for daemonizing dagit - I would probably recommend using a detached

screen

session as a simple place to start.

One quick follow up, the sleepy example still has named outputs. If I create a solid that is a generator will each output still be able to be piped to the next solid (aka process each chunk sequentially) ?

Something along the lines of this structure.

Is there an Issue on GH that we can follow?