Guys I am experiencing some issues with my dagit d...
# deployment-kubernetes
r
Guys I am experiencing some issues with my dagit deployment. I see this error frequently in my GCP logs. Any ideas?
"Liveness probe failed: Get "<http://10.87.6.3:80/dagit_info>": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
j
cc @max bc
while awaiting headers
might be suspicious?
In general @Rubén Lopez Lozoya, the /dagit_info is the endpoint for our livenessProbe on dagit. The first solution I’d suggest is increasing the resource requests for the dagit pod. Are you noticing any slowness when just using dagit?
r
It works well always. Everything is left as it was in helm chart except having 2 Dagit replicas
j
Hmm. Unusual but maybe you could just increase the tolerance for the livenessProbe (
dagit.livenessProbe
) in the values.yaml
r
What param should be I increasing exactly? ^^
r
Thanks, I will try!
m
this doesn’t ring a bell @johann — I’m not sure what dagit_info is doing
n
I would strongly recommend y'all remove the liveness probe
1
It has no reason to be there.
j
Curious about this, I’ll message you directly