Josh Alexy01/28/2023, 12:52 AM
I basically want to sense when we add an unprocessed doc/dir to the user_id key in s3, so I can take
- big bucket - id_1 - folder_for_certain_type_of_doc - unprocessed_doc.txt - id_2 - id_3
run it through dagster, and put it back into the same folder as
. Am I thinking about this incorrectly? Is this possible?
yuhan01/28/2023, 1:42 AM
Josh Alexy01/28/2023, 1:46 AM