Hello, is it possible to configure volume mounts f...
# deployment-kubernetes
m
Hello, is it possible to configure volume mounts for K8sRunLauncher jobs? I can't seem to find something in the helm chart. 🙂
n
I don't think so
j
Feel free to submit an issue requesting this!
Or a pr 🙂
👍 1
n
It would have to be an RWX volume and those get very dicey. An io_manager and minio is probably going to be better long term 😕
(but a bunch more complicated)
m
Why would that get dicey if I may ask? I think I'm not experienced enough with dagster's source code to provide a solution with an io_manager. I will probably try out with a rwx volume and see how well it performs for our use case. If I'm confident enough about it I'll submit a pr. 🙂
n
RWX volumes some with heavy limitations because the POSIX file APIs were never designed to be a distributed database. The simplest option is NFS but that has all kinds of scaling and locking issues. CephFS can be scaled up well but requires deep knowledge and also the complexity of actually running Ceph 🙂
They are almost always a thing you will regret using in the future 😄
👍 1