hey friends <!here>, this slipped out kind of quietly last week, but we recently pushed out a new Env Vars UI on Dagster that lets you natively manage secrets. the new Env Vars tab is accessible from the Deployments tab. Check out the blog here: https://dagster.io/blog/dagster-managing-secrets to learn more about how to use it and how its implemented, we’d love to hear your feedback on it.

Hi folks We are looking into dragster to see if it fits our need in a data mesh setup. dbt Cloud has projects. This means each team/domain has its own dbt cloud project without access to others. Is something similar possible in a dragster, or do we need to buy a new dragster cloud pr domain/team?

This message was deleted.

Hi folks, I am getting the below error. please help?

memory availability for the job runners (update: on Cloud Serverless) seems to be fluctuating quite a bit. it’s typically ~32GB, but I got 3.8GB this on this one and it causes the job to fail:

message has been deleted

I've been testing an issue with a sensor on the dagster cloud. I've been encountering a

dagster._core.errors.DagsterUserCodeUnreachableError: dagster._core.errors.DagsterUserCodeUnreachableError: Could not reach user code server

unreachable issue. I have resolved the issue, however this took quite a bit of trial and error, is there a way to debug/ see the logs on these kinds of errors on dagster cloud

I also am stuck getting the above type of error, DagsterUserCodeUnreachableError, in Dagster Cloud but not for a sensor. It's for an asset materialization that worked fine until my latest deployment. The stack trace doesn't have any of my code in it though. How can I debug this?

Hey, we're getting "Agent e4cc09c5 detected that run worker failed: The code location server that was hosting this run is not responding. It may have crashed or been OOM killed." when trying to materialize assets in a job by running said job manually. However, if we try to materialize asset by asset, all is well. How can we debug this?

I have another issue with Cloud that is urgent. My scheduled jobs ran successfully this morning, but then, without any deployments on my side, my code location is totally unavailable. I have tried redeploying twice with no luck, and it looks like an internal DNS issue. Full stack trace in thread:

Good day! I am currently using Dagster Cloud hybrid running on AWS Fargate and I have a question about how to control the compute resources that Fargate tasks use to execute. I know that it is possible to customize the CPU and memory of every run for a job using

@job(tags={"ecs/cpu": "256", "ecs/memory": "512"})

. However this only sets the resources of the Fargate task executing runs (the

run_*

task definitions). Is it possible to customize the CPU and memory of the task that is loading the repository as well (i.e.: the

server_*

task definition)? Thank you!

I think I am having a bug with dagit in dagster-cloud UI: There is one SDA which remains stale - even after manually triggering a materialization. How can I get it back to green?

When using hybrid deployments of dagster cloud, in the past non-isolated runs were possible (by opting in into the beta feature) since GA of this feature for serverless, it seems to be gone in hybrid for me. Is this true? How can I get non-isolated runs to launch in hybrid?

hi team! quick question - if we use dagster to kick off and manage a spark job on EMR, do we need to pay for compute? eg. dagster creates an emr cluster, submits a job that takes 5 hours, and turns down the cluster. the entire pipeline takes 6 hours. the total cost would be: 6 hours x 60 minutes x compute minute price (let's say $0.03) = $10.80

Error: some locations failed to load after being synced by the agent

Getting the above error. please help? using dagster serverless for the deployment

I added an environment variable in Dagster Cloud UI, but when I started a job it couldn't find my env var. Do I need to do extra steps (reload code location, update agent to a particular version, etc)? I don't see the env var set on my k8s pod, but I assume it's picked up / published later in the process than that.

I am getting read timed out during code location deployment upgrade for a 4GB docker image. Can you increase the timeout limit?

I have a job which should conduct a backfill for partitioned assets. The assets and the job have the daily partitions definition attached. However, only the normal-non backfill jobs shows the assets as green after materialization. The backfill job successfully materializes the assets. However, the partition does not show up as green - and furthermore the backfill is also not possible (no backfills for <<<job_name>>> is written on the page of this job

I am using azure pipelines to deploy dagster. I want to have user code deployment to be seperate from the demon/dagit deployment. I am trying to deploy user code deployment from a seperate project from Azure. Is this possible or should I have a user code deployment from the same project as that of demon/dagit deployment ? Please suggest

Local testing question: I noticed sensors seem to be disabled for Branch Deployments. How do I test sensors & the like locally? I have tried running both

dagit

in the repo dir and

dagster-daemon run

, but they don't seem to talk to each other (the status panel in

dagit

shows that there are no daemons running).

Hi, we'd like to monitor our Dagster Cloud usage. Is it possible to get how many minutes were billed for a job in

RunStatusSensorContext

? Or maybe there are other ways to alert us when we're closing a threshold of sorts?

I'm running into an issue with lightgbm on dagster cloud. I have had lightgbm in my requirements.txt, but I just now added code that called it (in a branch deployment). My code location didn't load, and returned "OSError: libgomp.so.1: cannot open shared object file: No such file or directory". It looks like the fix is easy if I had control over the dockerfile: https://stackoverflow.com/questions/55036740/lightgbm-inside-docker-libgomp-so-1-cannot-open-shared-object-file. I'm not sure what I can do myself though. How can I fix this?

Hello...I had to restart my dev agent after a long time. dagster-cloud is now at version 1.1.6 I'm getting this error now

AttributeError: 'CommandInfo' object has no attribute 'rich_help_panel'

For the e-mail address registered in our dagster-cloud deployment we do not receive the invoices. (they are available for download from the UI, but it would be great if these were automatically distributed to the mail address.

I recently ran into an issue with dagster cloud where a process that normally takes 3-10 minutes hung for 77 hours, what process should I use to figure out why this happened. Also, is there any way to add alerting around this?

👋 today I got this error while checking usage

Operation name: TrialTagQuery

Message: Internal Server Error (Trace ID: 6255748206621332504)

Path: ["customerInfo","stripeSubscription","trialServerlessStepDurationUsage"]

Locations: [{"line":10,"column":9}]

I am wondering if there is a way to configure S3 profiles on Dagster Cloud? I would like to make use of the dagster-aws and specify different profiles for different ops. Thanks!

Hi friends, any reason why my assets would be

Stale

even after they are materialized? I'm on the hybrid setup and latest version of Dagster

Hi there, I've changed my github email address and now dagster cloud doesn't let me log in using github anymore 😰

Hi, I am exploring dagster cloud and trying to connect a local code location (on my laptop) to the cloud. When running

serverless deploy

I get the following error at the last step in the build process:

Error response from daemon: login attempt to https://657821118200.dkr.ecr.us-west-2.amazonaws.com/v2/ failed with status: 400 Bad Request