19913d85-f662-4518-a9a1-7adc1793dfd4.png){kind=small}
Is there a cursor-esque way to use schedules? My s...
# ask-communityc
Charlie Bini
07/27/2023, 2:59 PMIs there a cursor-esque way to use schedules? My sensor keeps timing out because the total time of the evaluation function sometimes takes longer than 60 seconds. I can't break it up because it relies on opening an SSH tunnel, which would cause a conflict with multiple sensors running at the same time
a
Adam Bloom
07/27/2023, 3:05 PMCursor esque way meaning conditionally evaluate whether or not to actually trigger a run? Yes, I can dig up and example in a few
c
Charlie Bini
07/27/2023, 3:06 PMin that there's a cursor persisted between runs that I can easily pull and update
Charlie Bini
07/27/2023, 3:06 PMbasically I want a "sensor" that can run longer lol
a
Adam Bloom
07/27/2023, 3:07 PMHmm, I’m not sure how to do that. You could use asset metadata (if this is an asset job) - access the metadata from the last materialized asset in your schedule
c
Charlie Bini
07/27/2023, 3:08 PMooh that's not a bad idea
Charlie Bini
07/27/2023, 6:07 PMah so the downfall of this idea is that my assets are dynamically partitioned, so they can't be on the same job, which means they can't use the same schedule
Charlie Bini
07/27/2023, 6:09 PMBUT it looks like @yuhan has a PR that would resolve that https://github.com/dagster-io/dagster/pull/15348
s
sandy
07/27/2023, 11:33 PMalas I think Yuhan's PR will only work for assets that have the same partitioning
c
Charlie Bini
07/28/2023, 12:03 AMwomp
Charlie Bini
07/28/2023, 12:04 AM@sandy I've seen some threads about setting
DAGSTER_GRPC_TIMEOUT_SECONDSCharlie Bini
07/28/2023, 12:05 AMdo you know where I should set that value in a helm chart for dagster cloud (hybrid deployment)?
Charlie Bini
07/28/2023, 12:06 AMwill it work if I set it on the envvar UI?
s
sandy
07/28/2023, 3:11 PMmind asking that question is the #dagster-cloud channel? this isn't my area of expertise, but someone should be able to help you there
👍 1