https://dagster.io/ logo
#ask-community
Title
# ask-community
a

Alec Koumjian

12/27/2022, 4:07 PM
Do assets need to be able to fit into memory? I'm guessing practically they do and that partitioning is the recommended path to avoid assets which are too large for in memory processing?
d

Daniel Mosesson

12/27/2022, 4:28 PM
No, you can use
DynamicOut
for this
s

sandy

12/27/2022, 4:38 PM
I just wrote up slightly longer answer for this here: https://github.com/dagster-io/dagster/discussions/11387.
a

Alec Koumjian

12/27/2022, 4:40 PM
Thank you for the detailed response, reading this now!