I've run in to some trouble using the dagster-pand...
# announcements
w
I've run in to some trouble using the dagster-pandas DataFrame validation. The builtin ColumnTypeConstraints are limited in the dtypes they recognize. For example the string_column only checks for 'object' and not the Pandas 'string' dtype, boolean_cooumn only checks 'bool' and not the Pandas 'boolean' dtype, etc. Would there be any interest in reworking the ColumnTypeConstraints to use the built in Pandas dtype checking API (i.e. is_string_dtype)?
1
d
agreed that having post pd 1.0 dtypes available in the dagster-pandas library would be v nice
a
cc @abhi
a
Ah that's a great point. We definitely need to expand the supported types. Filing an issue