The cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability.

dagster

Hi! How to correctly configure `values.yaml` (which exact section) to provide ENV or K8S Secrets for correct substitution inside Dagster config system? Is it `runLauncher` section?

image.png

I’m trying to run sample job with config field provided by `StringSource` from ENV variable. I’m using Dagit launch view.

In `values.yaml` `env` can be configured for various execution contexts: `dagit` `dagster-user-deployments` `pipelineRun` `dagsterDaemon` `runLauncher` etc.

It is little bit confusing in which exact moment and in which of those contexts ENV variables substitution inside configs is happening.

Hi Ivan - right now there are two places (we are  working on bringing it down to one, agree that this is confusing): In dagster-user-deployments for the deployment that's serving your code, and in the runLauncher. The former will ensure that the user code deployment has it when it is launching your run, and then the runLauncher will ensure that when you actually go to the launch the run, it's there as well.