Hi all! I'm trying to output my pandas dataframe to a parquet file in a local folder. I've tried the following:
• With path being a config input - I've checked that it is a valid path
• It does run successfully, without any errors, however no file is produced!
• Also aware that there is a 'parquet_partition_io_manager' resource from the Hacker News example, however I haven't quite wrapped my head around it 😅. I'm trying to do a simple solution here, however, I'm open to learning about using resources and best practices.