martin o leary
08/26/2023, 1:59 PMDockerRunLauncher
with multiple code locations via docker compose.
Do I need to provide environment variables needed for all code location images in the one place or is there a way to provide per code location environment variables?
I think the only place I can provide environment variables to the containers for running jobs is in dagster.yaml
right?
i.e.
run_launcher:
module: dagster_docker
class: DockerRunLauncher
config:
env_vars: <- provided to all run containers
- DAGSTER_POSTGRES_USER
- DAGSTER_POSTGRES_PASSWORD
- DAGSTER_POSTGRES_DB
network: dagster_network
container_kwargs:
volumes: # Make docker client accessible to any launched containers as well
- /var/run/docker.sock:/var/run/docker.sock
- /tmp/io_manager_storage:/tmp/io_manager_storage
martin o leary
08/31/2023, 1:40 PM