https://dagster.io/ logo
a

Auster Cid

02/25/2020, 8:51 PM
hi all, quick question: is it possible to set up partitions on more than a single axis?
a

abhi

02/25/2020, 8:58 PM
Yes. However, partition sets take flat lists. If you enumerate your grid and map each point in that space to a "human readable" partition, you can pass a list of numbers which represent a combinatorial explosion of your partitions and generate the human readable string when you need assuming you have that lookup lying around somewhere in your code.
👍 1
m

max

02/25/2020, 9:03 PM
@sashank has thought a lot about this
very interested in your use cases here -- i am convinced that multivariate partitions are going to be very powerful
s

sashank

02/25/2020, 9:26 PM
We’re trying to figure out the best way to support this so would love to hear your thoughts
a

Auster Cid

02/25/2020, 9:45 PM
Well, for my use-case, being able to define multiple partition sets and their ordering (or hierarchy if you will) would work