Andy Chen

01/07/2022, 2:26 PM
Hey! Does dagster-pandas have the equivalent of “dtypes” in pandera? I basically have a csv path that's an input to one of my ops, and I want to read that csv into a data frame. I want to explicitly define the types on its columns, but I don't want to define both the pandas-dagster schema and the dtype dictionary to pass into read_csv. In pandera, it looks like you can just define the schema once and then call .dtypes to pass into read_csv. Curious if you guys have a similar helper function or if I should just go with pandera?


01/07/2022, 3:26 PM
cc @sean