Hi! Can I use an asset to represent a folder/directory such that every time the asset gets materialized the contents of the folder get refreshed? For context, I have an op that performs an action based on a YAML file. The content of the YAML is generated/managed/updated by another system. Every time there's a change, the YAML file is uploaded to an s3 bucket to overwrite the previous file in the s3 bucket. I want to always have the latest version of this file available in a path/directory accessible to Dagster and was wondering if I can use an Asset and a sensor to achieve the file sync or if this is something meant specifically for an OP? Thanks in advance for sharing your thoughts!

Do you drop and recreate the entire folder each time? Or do you operate on individual files within the folder? Are there multiple YAML files?

The entire folder...I dumbed down my context. I actually need to unzip an entire folder into a path Dagster can access

here's an example that unzips an entire folder: https://docs.dagster.io/tutorial/managing-your-own-io#tutorial-part-7-managing-your-own-io. would this work for you?

Sweet! Thanks, Sandy!

Using a sensor to detect when the zip file has been overwritten and trigger the asset sounds like a good idea to me

Thank you 🙏🏻