Hello believe I ve read all the documentation and searched a

Question

Hello believe I ve read all the documentation and searched all of the threads resembling this issue Getting an error I can t fix in the toy problem confused Any advice on `Error 1 Missing required field solids at document config root Available Fields execution loggers resources solids storage ` Still on serial pipeline py Windows 10 Anaconda pip installed ` pipeline` `def serial pipeline ` `sort by calories load cereals ` `def test serial pipeline ` `res = execute pipeline serial pipeline environment dict=ed ` `assert res success` `if name == main ` `result = execute pipeline serial pipeline ` `assert result success`

alex · Answer

what `sort by calories` and `load cereals` are you using The error indicates that some piece of information is missing that is required for execution such as `load cereals` needing to have an input defined

Ben Smith · Answer

`ed = ` ` solids ` ` load cereals ` ` inputs ` ` csv path value C Users bsmith OneDrive Catalina Marketing Python catmktg scratch cereal csv ` ` ` ` ` ` ` ` ` ` solid ` `input defs= InputDefinition name= csv path str ` ` ` `def load cereals context ` `dataset path = context solid config csv path ` ` Reading from csv path format csv path=dataset path ` `with open dataset path r as fd ` `cereals = row for row in csv DictReader fd ` ` ` ` Found n cereals cereals format n cereals=len cereals ` ` ` `return cereals` ` solid` `def sort by calories context cereals ` `sorted cereals = list ` `sorted cereals key=lambda cereal cereal calories ` ` ` ` ` ` Least caloric cereal least caloric format ` `least caloric=sorted cereals 0 name ` ` ` ` ` ` ` ` Most caloric cereal most caloric format ` `most caloric=sorted cereals 1 name ` ` ` ` `

Ben Smith · Answer

That might have sorted it adding InputDefinition seems to have changed the error Thanks much Alex Really getting confused about the difference between Inputs and Config when I should put my inputs in config and when I should config my inputs Appreciate you helping me wrap my noodle around it

Ben Smith · Answer

No it was removing the csv path argument to load cereals that changed the error Full code still getting missing required field solids at document config root `import csv` `from dagster import execute pipeline pipeline solid Field InputDefinition` `ed = ` ` solids ` ` load cereals ` ` inputs ` ` csv path value C Users bsmith OneDrive Catalina Marketing Python catmktg scratch cereal csv ` ` ` ` ` ` ` ` ` ` solid ` `input defs= InputDefinition name= csv path ` ` ` `def load cereals context csv path ` `dataset path = context solid config csv path ` ` Reading from csv path format csv path=dataset path ` `with open dataset path r as fd ` `cereals = row for row in csv DictReader fd ` ` ` ` Found n cereals cereals format n cereals=len cereals ` ` ` `return cereals` ` solid` `def sort by calories context cereals ` `sorted cereals = list ` `sorted cereals key=lambda cereal cereal calories ` ` ` ` ` ` Least caloric cereal least caloric format ` `least caloric=sorted cereals 0 name ` ` ` ` ` ` ` ` Most caloric cereal most caloric format ` `most caloric=sorted cereals 1 name ` ` ` ` ` ` pipeline` `def serial pipeline ` `sort by calories load cereals ` `def test serial pipeline ` `res = execute pipeline serial pipeline environment dict=ed ` `assert res success` `if name == main ` `result = execute pipeline serial pipeline ` `assert result success`

Ben Smith · Answer

Following up for posterity I was and continue to mix up the concepts of input and config In the code above I declared inputs in the environment dictionary but used the config variable in the body of the function the dataset path variable in the load cereals solid was set to solid config csv path Once I aligned to use inputs everywhere in the environment dict ed in the solid decorator and in the body of the function the pipeline was able to process

alex · Answer

gt I was and continue to mix up the concepts of input and config ya the difference is subtle if not arbitrary at times so this is very valid criticsm Thanks for posting a follow up