Jeremy
04/05/2023, 9:53 PMFileManager
resources write to, forcing the use of uuids. A couple of use-cases for this: an asset that produces a data-set to be written to disk; a sensor that triggers a job based on a new file that produces an output file to be wrapped in a light weight api. I guess my first question is, am I missing something; is there some reason this is a really bad idea? If not, would it be possible to add that functionality with an optional argument that defaults to the existing uuid implementation? I'd be happy to open an issue and PR for this.Daniel Gafni
04/06/2023, 3:32 PMsandy
04/07/2023, 3:55 PMFileManager
is a concept from Dagster's infancy that hasn't been updated in a while. We're interesting in revisiting it at some point. I'm honestly a little bit hazy on it.
It's meant to abstract over the physical location of the files - if you know where the file should be stored, why not just write there directly?Daniel Gafni
04/07/2023, 4:01 PMJeremy
04/07/2023, 4:05 PM