jurelou
06/25/2021, 2:50 PMis_required=False
parameter
@solid(
output_defs=[
OutputDefinition(name="a", is_required=False),
OutputDefinition(name="b", is_required=False),
OutputDefinition(name="c", is_required=False)
]
)
def generate_branches(file_path: str):
if 1 == 1:
yield(None, output_name="a")
else:
yield(None, output_name="b")
@solid
def proc_file(file_path):
branches = generate_branches(file_path=file_path)
@pipeline()
def my_pipeline():
input_files = gather_files()
output_files = input_files.map(proc_file)
end(output_files.collect())
alex
06/25/2021, 2:56 PMKeyError
shown below?jurelou
06/25/2021, 3:38 PMalex
06/25/2021, 3:39 PMgenerate_branches
@solid
in the body of the proc_file
@solid
jurelou
06/25/2021, 3:44 PMproc_file
a nested function inside the pipeline function ?
How am I supposed to manage dependencies between solids? ( I've tried to use the composite_solid
it does not solves the problemalex
06/25/2021, 3:49 PMSo should I makethat or just remove thea nested function inside the pipeline function ?proc_file
@solid
decorator, but i suspect its more clear to make it an inline function
How am I supposed to manage deendencies between solids?It looks like you are doing things generally right - so i might need a more specific example to understand where you are stuck
jurelou
06/25/2021, 3:57 PMcollect
on c.map(echo)
?alex
06/25/2021, 3:58 PM