Philippe Laflamme
07/05/2023, 8:28 PMyield
one Output
per partition or is it the responsability of the IO manager to figure this out? Specifically in my case, my asset produces `DataFrame`s and the IO manager writes them as parquet (one file per partition): where should I cut up this DataFrame
?Tim Castillo
07/06/2023, 10:56 PMPhilippe Laflamme
07/07/2023, 1:48 AMDataFrame
per partition and yield Output(df)
for each? How do I indicate which partition a particular DataFrame
is for? Perhaps what you are saying is that it's the I/O manager's job to figure this out?