Amanda Crawford
08/21/2019, 9:12 PMSelector
. Because this solid is an internal to the dag (non a start node) I am not able to (or just don't know how to) pass in the solid config because the value is outputted by the previous solid. I have downloaded a file from s3 and the output is file path string to a csv file. Once I have this, I would then like to use the example sum_solid
solid used in the airline_demo code that takes in this file path and using the dagster_pandas.Dataframe type. I was looking at the source code and see the Dataframe type uses a Selector
to determine how to handle the data. Is there a way to properly do this?alex
08/21/2019, 9:20 PMSelector
is a tool used for materializing an instance of a value from configuration. If you are flowing information solid to solid using inputs and outputs - it shouldn't come in to play.download_from_s3
genericpath
-> DataFrame
Amanda Crawford
08/21/2019, 9:26 PMalex
08/21/2019, 9:28 PMAmanda Crawford
08/21/2019, 9:30 PMalex
08/21/2019, 9:31 PMAmanda Crawford
08/21/2019, 9:33 PM