19913d85-f662-4518-a9a1-7adc1793dfd4.png){kind=small}
I am curious the best way to exclude some Dagster/...
# deployment-kubernetesd
Dusty Shapiro
01/09/2023, 6:22 PMI am curious the best way to exclude some Dagster/Airbyte stream configs from the application build and instead provide it as a ConfigMap.
I am not experienced in using ConfigMaps or Volumes, but curious what the best method (and allowable using Helm deployment) to reference configuration yamls within the application code.
d
daniel
01/09/2023, 6:25 PMHi dusty - I think you would use a volume for this: https://kubernetes.io/docs/concepts/storage/volumes/#configmap
daniel
01/09/2023, 6:26 PMhttps://docs.dagster.io/deployment/guides/kubernetes/deploying-with-helm#step-61-configure-the-deployment has an example of configuring a volume and volume mount in your code (you typically need to specify both, its a bit finnicky)
daniel
01/09/2023, 6:27 PMlooking it over now that example yaml is a bit weird - typically the volume mount would have the same name as the volume
daniel
01/09/2023, 6:27 PMour example is weird that is, the k8s example is fine
d
Dusty Shapiro
01/09/2023, 6:27 PM👍 sounds good I’ll have a look.
Dusty Shapiro
01/09/2023, 6:29 PMSo it just makes that volume data accessible in the user deployment mode in the
/etc/config/d
daniel
01/09/2023, 6:30 PMyeah it'd be available in any pod that dagster spins up for that code
daniel
01/09/2023, 6:30 PMruns too
d
Dusty Shapiro
01/09/2023, 6:30 PM👍 Sounds great, will get into it. Looks to be the perfect solution for the Airbyte stream configurations.
Dusty Shapiro
01/09/2023, 7:09 PMAnother question specific to Volumes/Configmaps…does the configMap name value under
volumesDusty Shapiro
01/09/2023, 7:09 PMor will that create a configMap for me with that value
d
daniel
01/09/2023, 7:09 PMthe former
d
Dusty Shapiro
01/09/2023, 7:18 PMGot it -thanks. Got it up and wired up, now I’m just brainstorming on best way to push changes to the volume (I assume just a redploy?)
a
Andrea Giardini
01/10/2023, 9:42 AMIf the configmap is mounted as a volume then updating the configmap will automatically update the file in all the pods mounting it. This might take some time depending on the Kubernetes configuration of your provider (up to two minutes is expected).
Otherwise, if that’s not a viable solution you can always create a new configmap and point your deployment to it, but this will require a rollout.
3 Views