https://dagster.io/ logo
Title
m

madhurt

08/06/2021, 5:52 PM
Hi, I am trying to implement my own custom IOManager. The way our pipeline is designed currently is that all solids return
Nothing
i.e. the
handle_output()
of the IOManager will always have
obj
as
None
. Thus, the dependencies are specified using
input_defs=[InputDefinition("name_of_previous_solid", Nothing)]
for the next solid. I still want the logic of
load_input
of my custom IOManager to work before we start executing this next solid. But it seems it skips it altogether. Any suggestions on what can be done?
a

alex

08/06/2021, 5:59 PM
all solids return Nothing  i.e. the handle_output() of the IOManager will always have obj  as None
So there is a difference between
Nothing
which is the absence of an output, ie
handle_output
should not be invoked and the case you are describing where it actually the value
None
I think you should get the behavior you see if you switch away from using
Nothing
and let the inputs/outputs be
Any
or set them maybe to
None
m

madhurt

08/06/2021, 7:15 PM
Thanks, it worked