This turned out to be http://tracker.ceph.com/issues/4122 for those following along at home. We were bitten by a change to boost::spirit. On 03/02/2013 11:54 AM, Mr. NPP wrote:
yes that works, the chatroom helped and i get this to work qemu-img info rbd:libvirt-pool/gentoo-vm so i got past those issues and now i'm stuck again. 2013-03-02 11:53:44.825985 7f9713fff700 1 -- 10.52.254.3:0/1018805 <http://10.52.254.3:0/1018805> <== mon.0 10.52.254.4:6789/0 <http://10.52.254.4:6789/0> 6 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (1461124100 0 0) 0x7f9704001190 con 0x7f9720736f80 2013-03-02 11:53:44.825995 7f9713fff700 10 monclient: handle_subscribe_ack sent 2013-03-02 11:53:44.821937 renew after 2013-03-02 11:56:14.821937 2013-03-02 11:53:44.826129 7f9713fff700 1 -- 10.52.254.3:0/1018805 <http://10.52.254.3:0/1018805> <== mon.0 10.52.254.4:6789/0 <http://10.52.254.4:6789/0> 7 ==== osd_map(15..15 src has 1..15) v3 ==== 4491+0+0 (4288196624 0 0) 0x7f9704000ae0 con 0x7f9720736f80 2013-03-02 11:53:44.826284 7f9713fff700 1 -- 10.52.254.3:0/1018805 <http://10.52.254.3:0/1018805> <== mon.0 10.52.254.4:6789/0 <http://10.52.254.4:6789/0> 8 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (1461124100 0 0) 0x7f9704002260 con 0x7f9720736f80 2013-03-02 11:53:44.826299 7f9713fff700 10 monclient: handle_subscribe_ack sent 0.000000, ignoring 2013-03-02 11:53:44.826308 7f9713fff700 1 -- 10.52.254.3:0/1018805 <http://10.52.254.3:0/1018805> <== mon.0 10.52.254.4:6789/0 <http://10.52.254.4:6789/0> 9 ==== osd_map(15..15 src has 1..15) v3 ==== 4491+0+0 (4288196624 0 0) 0x7f9704003620 con 0x7f9720736f80 2013-03-02 11:53:44.826349 7f9713fff700 1 -- 10.52.254.3:0/1018805 <http://10.52.254.3:0/1018805> <== mon.0 10.52.254.4:6789/0 <http://10.52.254.4:6789/0> 10 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (1461124100 0 0) 0x7f9704003980 con 0x7f9720736f80 2013-03-02 11:53:44.826357 7f9713fff700 10 monclient: handle_subscribe_ack sent 0.000000, ignoring 2013-03-02 11:53:44.826376 7f971ebfa900 20 librbd::ImageCtx: enabling writeback caching... 2013-03-02 11:53:44.826433 7f971ebfa900 20 librbd: open_image: ictx = 0x7f9720738f00 name = 'gentoo-vm' id = '' snap_name = '' 2013-03-02 11:53:44.826565 7f971ebfa900 1 -- 10.52.254.3:0/1018805 <http://10.52.254.3:0/1018805> --> 10.52.254.1:6805/5432 <http://10.52.254.1:6805/5432> -- osd_op(client.4810.0:1 gentoo-vm.rbd [stat] 3.50d89219) v4 -- ?+0 0x7f972073ad70 con 0x7f972073a9e0 2013-03-02 11:53:44.828473 7f9713fff700 1 -- 10.52.254.3:0/1018805 <http://10.52.254.3:0/1018805> <== osd.6 10.52.254.1:6805/5432 <http://10.52.254.1:6805/5432> 1 ==== osd_op_reply(1 gentoo-vm.rbd [stat] = -1 (Operation not permitted)) v4 ==== 112+0+0 (4279049108 0 0) 0x7f97000009a0 con 0x7f972073a9e0 2013-03-02 11:53:44.828591 7f971ebfa900 1 -- 10.52.254.3:0/1018805 <http://10.52.254.3:0/1018805> --> 10.52.254.1:6803/5148 <http://10.52.254.1:6803/5148> -- osd_op(client.4810.0:2 rbd_id.gentoo-vm [stat] 3.88180738) v4 -- ?+0 0x7f972073b550 con 0x7f972073b1f0 2013-03-02 11:53:44.829989 7f9713fff700 1 -- 10.52.254.3:0/1018805 <http://10.52.254.3:0/1018805> <== osd.4 10.52.254.1:6803/5148 <http://10.52.254.1:6803/5148> 1 ==== osd_op_reply(2 rbd_id.gentoo-vm [stat] = -1 (Operation not permitted)) v4 ==== 115+0+0 (3762661955 0 0) 0x7f96f80009a0 con 0x7f972073b1f0 qemu-system-x86_64: -drive file=rbd:libvirt-pool/gentoo-vm:debug_ms=1:debug_rbd=20:debug_monc=10:log_to_stderr=true:id=libvirt:key=AQDhNTFRKBRAFRAAnzrS9QkGa+eKZzkGNU1UOw==:auth_supported=cephx\;none,if=none,id=drive-virtio-disk0,format=raw: error reading header from gentoo-vm 2013-03-02 11:53:44.830025 7f971ebfa900 -1 librbd::ImageCtx: error finding header: (1) Operation not permitted 2013-03-02 11:53:44.830308 7f971ebfa900 1 -- 10.52.254.3:0/1018805 <http://10.52.254.3:0/1018805> mark_down 0x7f972073b1f0 -- 0x7f972073adc0 2013-03-02 11:53:44.830386 7f971ebfa900 1 -- 10.52.254.3:0/1018805 <http://10.52.254.3:0/1018805> mark_down 0x7f972073a9e0 -- 0x7f972073a780 2013-03-02 11:53:44.830495 7f971ebfa900 1 -- 10.52.254.3:0/1018805 <http://10.52.254.3:0/1018805> mark_down_all 2013-03-02 11:53:44.830720 7f971ebfa900 1 -- 10.52.254.3:0/1018805 <http://10.52.254.3:0/1018805> shutdown complete. qemu-system-x86_64: -drive file=rbd:libvirt-pool/gentoo-vm:debug_ms=1:debug_rbd=20:debug_monc=10:log_to_stderr=true:id=libvirt:key=AQDhNTFRKBRAFRAAnzrS9QkGa+eKZzkGNU1UOw==:auth_supported=cephx\;none,if=none,id=drive-virtio-disk0,format=raw: could not open disk image rbd:libvirt-pool/gentoo-vm:debug_ms=1:debug_rbd=20:debug_monc=10:log_to_stderr=true:id=libvirt:key=AQDhNTFRKBRAFRAAnzrS9QkGa+eKZzkGNU1UOw==:auth_supported=cephx\;none: Operation not permitted 2013-03-02 19:53:44.979+0000: shutting down i'm not sure why i'm getting operation not permitted from the osd's.
-- Dan Mick, Filesystem Engineering Inktank Storage, Inc. http://inktank.com Ceph docs: http://ceph.com/docs _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com