Drew You
06/07/2023, 2:01 PMio-manager
. I'd like to be able to wrap a dagster-pandas
create_dagster_pandas_dataframe_type
type and let dagster inspect that inner type. i.e. DrewsOutputType.inner = create_dagster_pandas_dataframe_type
. Are there any example implementations of something like this? I was looking at your Out
type and thinking of copying what you did there.sandy
06/08/2023, 10:10 PMDrew You
06/09/2023, 10:37 PMclass DrewsOutputType:
def __init__(self,one,two):
self._one = one
self._two = two
... some other processing methods
My io-manager.handle_output
then performs some processing on the output type to produce the materializations I would like. Often one: pd.DataFrame, two: pd.Dataframe
and in the case that they are, I'd like to be able to leverage dagster-pandas
for type checking