https://dagster.io/ logo
#ask-community
Title
# ask-community
n

Noah Ford

03/01/2023, 7:56 PM
It looks like a version >1.1.8 of
dagster
removed/moved
dagster.__core.storage.db__io_manager.TablePartition
. Is there way to find out what it should be replaced with?
s

sandy

03/01/2023, 8:01 PM
it was replaced with
TablePartitionDimension
. the purpose of this change was to allow DB IO managers to handle multiple-dimensional partitions fyi @jamie
ack 1
n

Noah Ford

03/01/2023, 8:29 PM
Poked around a bit in the new version but am unable to understand how to convert the following
Untitled.py
This is so we are able to delete a partition before its replacement is run, but accessing the time-window for the multi-dimensional partitions is throwing me off
j

jamie

03/01/2023, 8:33 PM
hey @Noah Ford with the change to
TablePartitionDimension
we now store a list of `TablePartitionDimension`s as the
partition_dimensions
attr of the
TableSlice
object. so you may need to iterate through that attr to access the
partition_expr
for each dimension
would also love to know how you’re using all of these db io manager concepts, i wasn’t expecting community use of them yet so it’d be great to know more about what you’re up to!
x

Xuan Mai Ho

03/01/2023, 10:18 PM
@jamie Noah’s colleague here! We implemented a Big Query IO manager based on the Snowflake IO manager. Although, I saw that you just made changes to the official BigQuery IO manager - will check it out! 👏
j

jamie

03/01/2023, 10:20 PM
oh nice! it’d be awesome to get any feedback you have on the built in one based on your experience building your own
4 Views