Just adding some more info in case it helps… looking at the ceph-osd.admin.log and I see this on every disk:
2016-06-30 09:47:03.326176 7f15353aa800 1 journal _open /dev/sdb1 fd 4: 24006098944 bytes, block size 4096 bytes, directio = 0, aio = 0 2016-06-30 09:47:03.326472 7f15353aa800 1 journal close /dev/sdb1 2016-06-30 09:47:03.326554 7f15353aa800 0 probe_block_device_fsid /dev/sdb1 is filestore, cff08772-4b94-4411-ba03-1e25fa1b567e 2016-06-30 09:47:08.096126 7f8adecbd800 0 ceph version 10.2.2 (45107e21c568dd033c2f0a3107dec8f0b0e58374), process ceph-osd, pid 8515 2016-06-30 09:47:08.096381 7f8adecbd800 -1 bluestore(/dev/sdc4) _read_bdev_label unable to decode label at offset 66: buffer::malformed_input: void bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past end of struct encoding
Does this line indicate a problem? "bluestore(/dev/sdc4) _read_bdev_label unable to decode label at offset 66: buffer::malformed_input: void bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past end of struct encoding”
Cheers, Mike
I am not sure why the mapping is failing, so I tried to install ceph on XenServer with ceph-deploy but got the following error:
[ceph_deploy][ERROR ] UnsupportedPlatform: Platform is not supported: XenServer xenenterprise 7.0.0 fddf
I feel like I am close but I am not sure where to go from here…
Cheers, Mike
Hi Jake,
Interesting… XenServer 7 does has rbd installed but trying to map the rbd image with this command:
# echo {ceph_monitor_ip} name={ceph_admin},secret={ceph_key} {ceph_pool} {ceph_image} >/sys/bus/rbd/add
It fails with just an i/o error… I am looking into now. My cluster health is OK, so I am hoping I didn’t miss a configuration or something.
On Wednesday, June 29, 2016, Mike Jacobacci < mikej@xxxxxxxxxx> wrote: Hi all,
Is there anyone using rbd for xenserver vm storage? I have XenServer 7 and the latest Ceph, I am looking for the the best way to mount the rbd volume under XenServer. There is not much recent info out there I have found except for this:
and this plugin (which looks nice):
I am looking for a way that doesn’t involve too much command line so other admins that don’t know Ceph or XenServer very well can work with it. I am just curious what others are doing… Any help is greatly appreciated!
Cheers, Mike
I'm not a XenServer user, so I can't help you there; but I feel your pain using Ceph for VMware storage.
I'm surprised that any major Linux distributions haven't considered enabling rbd modules in initrd.
I can see having a tiny OS image containing not much more than grub and the boot kernel. The trick would be to find a way to manage the boot string in the grub conf on a large scale.
Jake
|