Dave Katten
02/17/2023, 8:17 PMrun_launcher.config.env_vars
in dagster.yaml
• Build/fire up the docker compose
• Exec into the running user code container
• See that the env vars are there (yay)
• Go to dagit, fire off a run (where ops are looking for something in the env)
• Failed jobs - the env I expect isn’t there
The issue turned out to be a misconception I had about who’s launching the run. I was assuming that the user code image was launching from itself, but because I was using the docker-compose.yaml that set up a daemon and used the queued run launcher. So I needed to pass those envs through to the daemon container in docker-compose.yaml.
So my feedback is: please update the docs to be clear about where/how envs are passed, esp in the queued run coordinator context (and esp in the example docker-compose.yaml). Thanks yall!erin
02/17/2023, 8:40 PMCasper Weiss Bang
02/19/2023, 6:32 PM