https://dagster.io/ logo
Title
g

Graham Wetzler

02/01/2023, 11:58 PM
I’m having an issue where datetime Pandas dataframe columns are not being created as datetime columns in Snowflake. I created a basic proof of concept:
@asset
def dagster_df_dates():
    return pd.DataFrame(pd.date_range("2023-01-01", "2023-01-31"), columns=["A"])
In Snowflake this column is created as a varchar. What am I doing wrong?
j

jamie

02/02/2023, 2:46 PM
Hi Graham - i think there’s a conversion happening in the snowflake io manager. If i remember correctly, snowflake was incorrectly storing pandas datetime values, so we added a conversion step so the data got stored correctly. this might be fixed now, i’ll check it out and see