paul.q
06/30/2023, 7:51 AMs3_prefix="orchestration/alts/dev"
But the output went to the bucket root location with a key like: orchestration\alts\dev\storage\<run_id>
I think this is because this method, is returning a WindowsPath which is not being handled correctly downstream, since by the time it reaches here it will not be transformed properly into an S3 key with forward slashes.paul.q
07/04/2023, 1:01 AMpaul.q
07/05/2023, 12:15 AMself.s3.upload_fileobj(pickled_obj_bytes, self.bucket, str(path))
it now does this:
self.s3.upload_fileobj(pickled_obj_bytes, self.bucket, str(<http://path.as|path.as>_posix()))