https://dagster.io/ logo
#deployment-kubernetes
Title
# deployment-kubernetes
d

Daniel Mosesson

03/09/2023, 9:58 AM
we are trying to move to dagster on k8s, but all runs are giving an error:
Value in Mapping mismatches expected for key dagster/image. Expected value of type <class 'str'>. Got value of type <class 'NoneType'>
I tried explicitly setting the tag for the image to no avail. The example repo/job works though. Any idea what could be going on?
a

Andrea Giardini

03/09/2023, 12:43 PM
How are you deploying Dagaster to k8s? Are you using the helm chart?
d

Daniel Mosesson

03/09/2023, 12:56 PM
Yes
a

Andrea Giardini

03/09/2023, 12:56 PM
can you share your values.yaml ?
d

Daniel Mosesson

03/09/2023, 1:00 PM
only thing I configured was the ingress, everything else is the default
a

Andrea Giardini

03/09/2023, 1:01 PM
How are you deploying the code to kubernetes then? how did you configure the user deployments?
d

Daniel Mosesson

03/09/2023, 1:03 PM
modifying the workspace.yml to add the new location
(after I get the first one working, this is on my list to automate)
the location shows up, things just don't run
a

Andrea Giardini

03/09/2023, 1:03 PM
Are the deployments shown has healthy in dagit?
Can you post a screenshot of where you see this error?
d

Daniel Mosesson

03/09/2023, 1:04 PM
yup. That deployment was created with kubecutl create deployment
Can't do that, not on the same network 😞 I can retype anything you want though
a

Andrea Giardini

03/09/2023, 1:05 PM
In dagit, under the tab “deployment” are they all shown has healthy?
d

Daniel Mosesson

03/09/2023, 1:05 PM
Looking at a green loaded
and all the jobs/assets/sensors etc appear
and the sensor runs, it just can't start the runs
last functions in the call stack are: • add_run_tags • add_run_tags • mapping_param • _check_mapping_entries_
(first add run tags is in instance/_init_.py
second is in sql_run_storage.py
a

Andrea Giardini

03/09/2023, 1:08 PM
To me it looks like a misconfiguration. are you using
dagster-k8s/config
tag? or tags in general?
d

Daniel Mosesson

03/09/2023, 1:09 PM
No, do I need to?
a

Andrea Giardini

03/09/2023, 1:10 PM
no, no necessarily, but you should really add your user-deployments using helm as well. that would simplify things a lot. Do you get the same error when running locally?
d

Daniel Mosesson

03/09/2023, 1:11 PM
locally it just uses local executor, and it works fine (no docker image needed)
a

Andrea Giardini

03/09/2023, 1:11 PM
Yeah… try to use helm to configure your user-deployments. this will automatically fill a lot of boilerplate config
d

Daniel Mosesson

03/09/2023, 1:11 PM
dagster-user-deployments helm chart?
d

Daniel Mosesson

03/09/2023, 1:12 PM
I'll give it a whirl
Deployed. Do I still have to update the workspace configmap to add the deployment?
a

Andrea Giardini

03/09/2023, 1:35 PM
no, helm will do everything for you
d

Daniel Mosesson

03/09/2023, 7:15 PM
No idea what in there fixed it, but that worked. Thank you
2 Views