19913d85-f662-4518-a9a1-7adc1793dfd4.png){kind=small}
Channels
dagster-de
dagster-cube
gigs-freelance
dagster-wandb
dagster-machine-learning
dagster-bigquery
tools
dagster-dask
dagster-snowflake
dagster-releases
data-platform-design
events
dagster-serverless
dagster-noteable
introductions
dagster-airflow
dagster-cloud
random
dagster-dbt
faq-read-me-before-posting
dagster-airbyte
dagster-spatial
dagster-support
announcements
github-discussions
豆瓣酱帮
dagster-feedback
dagstereo
dagster-ecs
dagster-kubernetes
jobs
dagster-showcase
Title
d
Daniel Mosesson
03/09/2023, 9:58 AMwe are trying to move to dagster on k8s, but all runs are giving an error:
Value in Mapping mismatches expected for key dagster/image. Expected value of type <class 'str'>. Got value of type <class 'NoneType'>a
Andrea Giardini
03/09/2023, 12:43 PMHow are you deploying Dagaster to k8s? Are you using the helm chart?
d
Daniel Mosesson
03/09/2023, 12:56 PMYes
a
Andrea Giardini
03/09/2023, 12:56 PMcan you share your values.yaml ?
d
Daniel Mosesson
03/09/2023, 1:00 PMonly thing I configured was the ingress, everything else is the default
a
Andrea Giardini
03/09/2023, 1:01 PMHow are you deploying the code to kubernetes then? how did you configure the user deployments?
d
Daniel Mosesson
03/09/2023, 1:03 PMmodifying the workspace.yml to add the new location
(after I get the first one working, this is on my list to automate)
the location shows up, things just don't run
a
Andrea Giardini
03/09/2023, 1:03 PMAre the deployments shown has healthy in dagit?
Can you post a screenshot of where you see this error?
d
Daniel Mosesson
03/09/2023, 1:04 PMyup. That deployment was created with kubecutl create deployment
Can't do that, not on the same network 😞 I can retype anything you want though
a
Andrea Giardini
03/09/2023, 1:05 PMIn dagit, under the tab “deployment” are they all shown has healthy?
d
Daniel Mosesson
03/09/2023, 1:05 PMLooking at a green loaded
and all the jobs/assets/sensors etc appear
and the sensor runs, it just can't start the runs
last functions in the call stack are:
• add_run_tags
• add_run_tags
• mapping_param
• _check_mapping_entries_
(first add run tags is in instance/_init_.py
second is in sql_run_storage.py
a
Andrea Giardini
03/09/2023, 1:08 PMTo me it looks like a misconfiguration. are you using
dagster-k8s/configd
Daniel Mosesson
03/09/2023, 1:09 PMNo, do I need to?
a
Andrea Giardini
03/09/2023, 1:10 PMno, no necessarily, but you should really add your user-deployments using helm as well. that would simplify things a lot. Do you get the same error when running locally?
d
Daniel Mosesson
03/09/2023, 1:11 PMlocally it just uses local executor, and it works fine (no docker image needed)
a
Andrea Giardini
03/09/2023, 1:11 PMYeah… try to use helm to configure your user-deployments. this will automatically fill a lot of boilerplate config
d
Daniel Mosesson
03/09/2023, 1:11 PMdagster-user-deployments helm chart?
a
Andrea Giardini
03/09/2023, 1:12 PMd
Daniel Mosesson
03/09/2023, 1:12 PMI'll give it a whirl
Deployed. Do I still have to update the workspace configmap to add the deployment?
a
Andrea Giardini
03/09/2023, 1:35 PMno, helm will do everything for you
d
Daniel Mosesson
03/09/2023, 7:15 PMNo idea what in there fixed it, but that worked. Thank you