https://dagster.io/ logo
e

Eric

02/12/2020, 11:16 PM
Hi, is it possible to define input hydration functions without attaching them to a custom type ? For example, when a "csv" parameter in the yaml file is specified
Copy code
@input_hydration_config(Selector({"csv": Field(str)}))
def csv_input_hydration_config(context, selector) -> DataFrame:
    return read_csv(selector["csv"])
config.yaml
Copy code
solids:
  my_solid:
    inputs:
      csv: 
        value: ...path_to_csv
a

alex

02/12/2020, 11:20 PM
without attaching them to a custom type
Nope, you’ll need to attach them to a custom type.
👍 1
e

Eric

02/12/2020, 11:20 PM
thanks alex
a

alex

02/12/2020, 11:21 PM
a heads up - we’re about to push out 0.7.0 which changes up a lot of the dagster type api surface. Also here is a link to the docs against master as a preview of whats to come - linked to a section on DataFrames you may find relevant https://dagster.readthedocs.io/en/latest/sections/learn/guides/dagster_pandas/dagster_pandas.html
e

Eric

02/12/2020, 11:22 PM
exciting ! thanks for the heads up !