Aaron T
08/15/2023, 4:12 PMs3_pickle_io_manager
use the PickledObjectS3IOManager
instead of the ConfigurablePickledObjectS3IOManager
? Wouldn't it make more sense to use the configurable one since it utilizes caching? https://github.com/dagster-io/dagster/blob/master/python_modules/libraries/dagster-aws/dagster_aws/s3/io_manager.py#L224sean
08/15/2023, 8:12 PMs3_pickle_io_manager
is legacy and you should just directly use ConfigurablePickledObjectS3IOManager
instead. See here:
https://docs.dagster.io/concepts/io-management/io-managers#applying-io-managers-to-assets