Hey guys, been working with dagster a ton over the last few months. Y’all are killing it.
Finally gotten to the point where I’m trying to deploy dagster on Kubernetes, and I was surprised to find your documentation lacking. I’m particularly frustrated by the lack of documentation on creating one's own code images. The user code directory still refers to “pipelines”, and the example docker file shows very little structure. The user-code-example image isn't even available if I wanted to use it.
It is quite possible that I’ve misconfigured stuff with my Kubernetes config (I’m new to k8s), but from what I can see, it’s an issue with my code image.
Some more info about my environment:
• Host machine: Ubuntu 20.04, behind a corporate proxy
• Using Minikube for testing (spent a while getting it working, but it works)
Custom user code image hosted on a local, insecure registry
• User code image’s entry point is dragster api grpc <package name>, <attribute name> <host> <port (3030)>
• All images load fine, start to run fine (dagit, dagster-daemon, postgresql, etc)
• User code image gives “CrashLoopBackOff” when I run kubectl get pods
• When I use kubectl describe pods <user code image name>, it says something about “failed to pick subchannel”. I think this means that there’s an issue with grpc, but not sure if that’s on my side or the dagster helm side.
Super thankful for any and all help! You guys are making something great here!