https://dagster.io/ logo
Title
n

Nuchapol (Nut) Rattanapan

03/16/2023, 5:27 PM
Hi team, Is it able to trigger an asset when a file is created on GCS bucket (with or without knowing its filename)? I couldn’t find a way to achieve this. Do you guys have any suggestions?
t

Tim Castillo

03/16/2023, 6:25 PM
Hey Nut! Have you tried using a sensor to poll the GCS API for changes? We document a similar pattern here. Would just have to replace it with querying GCS.
n

Nuchapol (Nut) Rattanapan

03/17/2023, 5:21 AM
I’ve seen this before but I couldn’t find the function below or similar function for dagster-gcp in API Docs
from dagster_aws.s3.sensor import get_s3_keys
So, I still have no idea on how to use it, could u guide me a bit?
t

Tim Castillo

03/17/2023, 7:50 PM
Yeah,
dagster-gcp
doesn't have it, so you'd have to query the GCS API yourself to do it. ie. possible use this endpoint
😒aluting_face: 1