Hi team, just wanted to say that it's really gratifying to be looking to implement a particular workflow in dagster, and come across a feature that has just been implemented that aligns well with what I'm trying to do. In this case, the

MultiPartitionMapping

that @claire merged in this PR from a few weeks ago 🙂

Hahah, and on behalf of the team, we appreciate the kind words daggy love

Glad you found it useful, much appreciated!

So, following on from this, I'm delving deeper into multipartitions and was wondering if supporting > 2 partitions was on the roadmap? My use case is that I'm currently using the 2 partitions to partition by day and equipment ID, and am looking to run a series of forecasting techniques against each partition. Ideally I would add the forecast technique as a (3rd) partition, which is currently unsupported. It is not a big deal to treat them as separate assets per forecast type, it just adds a little bit of boiler plate. But was just interested if there are thoughts on extending multi-partitions.

Hey Benjamin, it's something that we've considered but isn't immediately on the roadmap. The blockers here are mostly just improving performance and updating the UI to handle more than two dimensions. I'd recommend filing a feature request for this if this is functionality you want. It would help to know how many dimensions you'd want and an estimate of the total number of partitions

Thanks Claire, I had imagined that was the case. For now I think splitting the 3rd dimension out into separate assets works reasonably for my use case, but I'll file a request if I feel that it's warranted.

reviving this ask on new thread in case there is a workaround. otherwise I'll raise a feature request as it's critical for my org's dagster adoption. https://dagster.slack.com/archives/C01U954MEER/p1688077355089059

@John Smith here is an example of using multiple assets to handle 3+ dimensions: https://gist.github.com/slopp/98753ab6efcd654da1b7a49c5639aabf

Thanks @Sean Lopp however this can quickly get very messy in the UI when I have 20 shapes and 20 colours. In my usecase I'd ideally want to see the diagram below in the UI, not each individual color or shape. only when I "drill" into each node (e.g. colorshape) do I want to see the "partitions" so I can see the woods from the trees at a higher level

This message contains interactive elements.