https://dagster.io/ logo
#integration-bigquery
Title
# integration-bigquery
d

Danilo Oliveira

08/21/2023, 7:20 PM
Hi Dagster team, I have another question: I'm using
BigQueryPandasIOManager
and the asset being materialized (Python) is partitioned by a column with
partitions_def=DailyPartitionsDefinition(start_date="2023-06-22")
, but when the code runs, the resulting Bigquery table is not actually partitioned. When I use a dbt asset, the resulting table is correctly partitioned (e.g. Bigquery shows a "This is a partitioned table." on the console). How can I activate this native BQ partitioning for python assets?
j

jamie

08/21/2023, 7:42 PM
the dagster bigquery io manager doesn’t support native bigquery partitions at the moment. here’s an issue for you to track https://github.com/dagster-io/dagster/issues/15975
🌈 1
d

Danilo Oliveira

08/21/2023, 7:42 PM
Thanks!
2 Views