https://dagster.io/ logo
#ask-community
Title
# ask-community
s

Simrun Basuita

05/10/2023, 10:59 AM
Hi, I have the exact same question about partitions as this poster: https://stackoverflow.com/questions/75703813/reduce-a-partitioned-asset-to-a-single-data-frame . Can we get an answer to this question (either here or on the site). Thanks! 🙂
🤖 2
a

Andras Somi

05/10/2023, 11:25 AM
If you use your own IO manager you can then define whatever behaviour you want in
load_input()
for loading a partitioned upstream into a non-partitioned downstream. It has the benefit of flexibility, but you might have to reimplement stuff that is otherwise available in the built-in IO managers (the partitions as a dict thing is actually a feature of the built-in IO manager, not a default thing — you can create whatever loading logic you need in a custom IO manager).
s

Simrun Basuita

05/10/2023, 12:21 PM
thanks Andras
s

sean

05/10/2023, 1:03 PM
Yes, what Andras said is exactly right.
2 Views