Hi team Really enjoying working with advocating for dagster

Question

Hi team Really enjoying working with advocating for dagster Have stumbled into a pickling error I m struggling to locate likely some misconfiguration my end bu having a hard time parsing the error to locate it Any pointers would be highly appreciated

James · Answer

Invoking the pipeline via `execute pipeline ` on latest Dagster version Also same problem running through Dagit

James · Answer

Dagit error is slightly more verbose and suggests a problem with the framework itself

max · Answer

wave Hi James

max · Answer

what is the type of that solid s outputs

James · Answer

Hi Max

James · Answer

``` OutputDefinition dagster type=List Dict String Any description= A list of dicts for all objects properties returned ```

James · Answer

Thinking about it the `Any` values in the Dicts are a mix of strings and various LDAP objects so there might be some slightly exotic stuff inside the LDAP bits

James · Answer

Perhaps advisable to extract all the LDAP data I want to basic data types prior to return pickling

max · Answer

yeah if you are trying to pickle stuff that has exotic values like threading locks in it that won t work

max · Answer

you can also write a custom type loader materializer

James · Answer

Great thanks for the prompt to get me thinking