19913d85-f662-4518-a9a1-7adc1793dfd4.png){kind=small}
Channels
dagster-de
dagster-cube
gigs-freelance
dagster-wandb
dagster-machine-learning
dagster-bigquery
tools
dagster-dask
dagster-snowflake
dagster-releases
data-platform-design
events
dagster-serverless
dagster-noteable
introductions
dagster-airflow
dagster-cloud
random
dagster-dbt
faq-read-me-before-posting
dagster-airbyte
dagster-spatial
dagster-support
announcements
github-discussions
豆瓣酱帮
dagster-feedback
dagstereo
dagster-ecs
dagster-kubernetes
jobs
dagster-showcase
Title
t
Toky Rakotondratsimba
05/15/2023, 2:19 PMCould you please reactivate our serverless agent? It was spun down after the trial ends. Asking in case the reactivation process is not yet automated. 🙏
dagster/agent_id:7ec7f869-bb3b-4d03-a230-cc7a8a95b96c
j
jordan
05/15/2023, 2:21 PMI can set this up now - sorry about that!
❤️ 1
what’s your organization?
t
Toky Rakotondratsimba
05/15/2023, 2:22 PMkovalee
j
jordan
05/15/2023, 2:23 PMi see it as already active
but i see a very deep run queue - i have a feeling it probably can’t keep up fast enough. let me dig a bit deeper to see if something is up.
t
Toky Rakotondratsimba
05/15/2023, 2:26 PMThank you. I thought it stopped taking jobs out of the queue because we ran out of trial compute minutes...
d
daniel
05/15/2023, 2:37 PMHi Toky - we're looking into this now. Just confirming, is the number of runs in this deployment intentional? You're aware of the limitations for using serverless described here? https://docs.dagster.io/dagster-cloud/deployment/serverless#limitations
t
Toky Rakotondratsimba
05/15/2023, 2:40 PMThe number of runs is intentional. However, I wasn't aware of the limitations of using serverless. Thanks for the info
Is it a limitation issue instead of an end of trial one?
d
daniel
05/15/2023, 2:43 PMUnrelated to your trial - we're looking into this and should have things back up and running shortly
(and unrelated to serverless limits - just making sure you wanted these all to run before we got them started again)
t
Toky Rakotondratsimba
05/15/2023, 2:44 PMok, perfect. Thanks
j
jordan
05/15/2023, 2:55 PMHow fast do you expect each of these to run? There are some throughput defaults in serverless and I just want to do some napkin math to see if we there’s enough throughput to eventually chew through this whole backlog.
Also, do you expect to continue enqueuing runs at this rate? Or does this represent a one time backfill?
t
Toky Rakotondratsimba
05/15/2023, 2:56 PMThis is a one time backfill.
👍 1
Each run takes less than 5s
👍 1
j
jordan
05/15/2023, 2:58 PMYou’re back up and running now - sorry about the interruption!
We’ll keep an eye on this specifically throughout the day to make sure it continues to work through the backlog.
t
Toky Rakotondratsimba
05/15/2023, 2:59 PMAmazing, thanks for your help
j
jordan
05/15/2023, 3:00 PMJust to set expectations though - it’s still going to take a long time to catch up.
t
Toky Rakotondratsimba
05/15/2023, 3:00 PMYes, that's fine.
FYI, I'll change the strategy and will just terminate all runs that are currently queued for now.