Sam Van Den Berghe02/15/2023, 3:46 PM
But we have a similar sensor that does the same but on a different dataset that is working fine. When running locally the sensor function completes fast enough. tried adding logs but those don’t appear.
dagster._core.errors.DagsterUserCodeUnreachableError: dagster._core.errors.DagsterUserCodeUnreachableError: The sensor tick timed out due to taking longer than 60 seconds to execute the sensor function.
jordan02/15/2023, 6:17 PM
Joseph Sayad02/15/2023, 9:00 PM
over the bucket (isolated in a notebook), which took ~23 seconds to get all keys. Though I experience a timeout in Dagster Cloud and no runs are requested. We might be able to get around the issue by editing the following code to only extract
keys from S3 as you mentioned @jordan
jordan02/16/2023, 7:56 PM