Hi all,
During last week I been trying to deploy the pre-existing ceph cluster with out openstack intance.
The ceph-cinder integration was easy (or at least I think so!!)
There is only one volume to attach block storage to out cloud machines.
The client.cinder has permission on this volume (following the guides)
...............
client.cinder
key: AQAonXXXXXXXRAAPIAj9iErv001a0k+vyFdUg==
caps: [mon] allow r
caps: [osd] allow class-read object_prefix rbd_children, allow rwx pool=volumes
ceph.conf file seems to be OK:
[global]
fsid = 6f5a65a7-316c-4825-afcb-428608941dd1
mon_initial_members = cephadm, cephmon02, cephmon03
mon_host = 10.10.3.1,10.10.3.2,10.10.3.3
auth_cluster_required = cephx
auth_service_required = cephx
auth_client_required = cephx
filestore_xattr_use_omap = true
osd_pool_default_size = 2
public_network = 10.10.0.0/16
cluster_network = 192.168.254.0/27
[osd]
osd_journal_size = 20000
[client.cinder]
keyring = /etc/ceph/ceph.client.cinder.keyring
[client]
rbd cache = true
rbd cache writethrough until flush = true
admin socket = /var/run/ceph/$cluster-$type.$id.$pid.$cctid.asok
The trouble seems that blocks are created using the client.admin instead of client.cinder
From cinder machine:
cinder:~ # rados ls --pool volumes
rbd_id.volume-5e2ab5c2-4710-4c28-9755-b5bc4ff6a52a
rbd_directory
rbd_id.volume-7da08f12-fb0f-4269-931a-d528c1507fee
rbd_header.23d5e33b4c15c
rbd_header.20407190ce77f
But if I try to look for using cinder client:
cinder:~ #rados ls --pool volumes --secret client.cinder
"empty answer"
cinder:~ # ls -la /etc/ceph
total 24
drwxr-xr-x 2 root root 4096 nov 3 10:17 .
drwxr-xr-x 108 root root 4096 oct 29 09:52 ..
-rw------- 1 root root 63 nov 3 10:17 ceph.client.admin.keyring
-rw-r--r-- 1 cinder cinder 67 oct 28 13:44 ceph.client.cinder.keyring
-rw-r--r-- 1 root root 454 oct 1 13:56 ceph.conf
-rw-r--r-- 1 root root 73 sep 27 09:36 ceph.mon.keyring
from a client (I have supposed that this machine only need the cinder key...)
cloud28:~ # ls -la /etc/ceph/
total 28
drwx------ 2 root root 4096 nov 3 11:01 .
drwxr-xr-x 116 root root 12288 oct 30 14:37 ..
-rw-r--r-- 1 nova nova 67 oct 28 11:43 ceph.client.cinder.keyring
-rw-r--r-- 1 root root 588 nov 3 10:59 ceph.conf
-rw-r--r-- 1 root root 92 oct 26 16:59 rbdmap
cloud28:~ # rbd -p volumes ls
2015-11-03 11:01:58.782795 7fc6c714b840 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication
2015-11-03 11:01:58.782800 7fc6c714b840 0 librados: client.admin initialization error (2) No such file or directory
rbd: couldn't connect to the cluster!
Any help will be welcome.
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
