| Hi, I’m trying run a Gerrit deployment on kubernetes. The deployment fails because the it can’t mount a ceph image with rbd-nbd. I tried to manually mount the image with "sudo rbd-nbd map rbd/xgrid-rep-test -m 172.31.141.8:6789,172.31.141.9:6789,172.31.141.10:6789 --keyfile keyfile"and it works. Here's the log for the pod: 2019-01-16 07:51:27.304427 7f66ea174100 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2019-01-16 07:51:27.304509 7f66ea174100 -1 auth: failed to decode key 'AQD7Vy9cmr5UMBAAukbm69Gfr+TbApeubjgahg' 2019-01-16 07:51:27.304516 7f66ea174100 0 librados: client.admin initialization error (22) Invalid argument rbd: couldn't connect to the cluster! ) Warning FailedMount 1m (x5 over 9m) kubelet, worker3 (combined from similar events): MountVolume.WaitForAttach failed for volume "pv-gerrit" : fail to check rbd image status with: (exit status 22), rbd output: (2019-01-16 08:00:41.288005 7f2f01c1d100 -1 auth: failed to decode key 'AQD7Vy9cmr5UMBAAukbm69Gfr+TbApeubjgahg' 2019-01-16 08:00:41.288019 7f2f01c1d100 0 librados: client.admin initialization error (22) Invalid argument rbd: couldn't connect to the cluster! ) Warning FailedMount 36s (x6 over 11m) kubelet, worker3 Unable to mount volumes for pod "gerrit-deployment-559c6fc6b5-9drpr_default(ffd798de-198c-11e9-b99a-fcaa1476b110)": timeout expired waiting for volumes to attach or mount for pod "default"/"gerrit-deployment-559c6fc6b5-9drpr". list of unmounted volumes=[gerrit-data]. list of unattached volumes=[gerrit-data default-token-cc5fj] I double checked the keys in /etc/ceph/ceph.client.admin.keyring on worker3 (copied them from a ceph moniter node) key = AQD7Vy9cmr5UMBAAukbm69Gfr+TbApeubjgahg== caps mds = "allow *" caps mgr = "allow *" caps mon = "allow *" caps osd = "allow *" Any idea what the issue with the key might be? Best -H |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
