won
02/25/2023, 5:15 PMBigQueryPandasTypeHandler
in my case obj.dtypes returns ('items', dtype('O')),
context.add_output_metadata(
{
"row_count": obj.shape[0],
"dataframe_columns": MetadataValue.table_schema(
TableSchema(
columns=[
TableColumn(name=name, type=str(dtype))
for name, dtype in obj.dtypes.iteritems()
]
)
),
}
)
can i use sqlalchemy.types ?
json_columns = ['foo','baz']
data_type = dict.fromkeys(json_columns, types.JSON) if json_columns else {}
df.to_sql(
table_name,
connection,
dtype=data_type,
if_exists="append",
index=False,
chunksize=1000,
)
https://cloud.google.com/bigquery/docs/reference/standard-sql/data-types#array-type