Can you run "rbd --id libvirt --pool libvirt win206-test-3tb <some temprary file name>" w/o error? It sounds like your CephX caps for client.libvirt are not permitting read access to the image data objects. On Wed, Jun 6, 2018 at 2:18 PM, Wladimir Mutel <mwg@xxxxxxxxx> wrote: > > Dear all, > > I installed QEMU, libvirtd and its RBD plugins and now trying > to make QEMU use my Ceph storage. I created 'iso' pool > and imported Windows installation image there (rbd import). > Also I created 'libvirt' pool and there, created 2.7-TB image > for Windows installation. I created client.iso and > client.libvirt accounts for Ceph authentication, > and configured their secrets for pool access in virsh > (as told in http://docs.ceph.com/docs/master/rbd/libvirt/ ). > Then I started pools and checked that I can list their contents > from virsh. Then I created a VM with dummy HDD and optical > drive, and edited them using 'virsh edit' : > > <disk type='network' device='disk'> > <driver name='qemu'/> > <auth username='libvirt'> > <secret type='ceph' uuid='ac1d8d7b-d243-4474-841d-91c26fd93a14'/> > </auth> > <source protocol='rbd' name='libvirt/win206-test-3tb'> > <host name='192.168.200.230' port='6789'/> > </source> > <target dev='sda' bus='sata'/> > <boot order='2'/> > <address type='drive' controller='0' bus='0' target='0' unit='0'/> > </disk> > > <disk type='network' device='cdrom'> > <driver name='qemu'/> > <auth username='iso'> > <secret type='ceph' uuid='cf00c7e4-740a-4935-9d7c-223d3c81871f'/> > </auth> > <source protocol='rbd' > name='iso/SW_DVD9_Win_Server_STD_CORE_2016_64Bit_Russian_-4_DC_STD_MLF_X21-70539.ISO'> > <host name='192.168.200.230' port='6789'/> > </source> > <target dev='sdb' bus='sata'/> > <readonly/> > <boot order='1'/> > <address type='drive' controller='0' bus='0' target='0' unit='1'/> > </disk> > > Now I see this in the systemd journalctl : > > чер 06 16:24:12 p10s qemu-system-x86_64[4907]: 2018-06-06 16:24:12.147 > 7f40f37fe700 -1 librbd::io::ObjectRequest: 0x7f40d4010500 > handle_read_object: failed to read from object: (1) Operation not permitted > > What should I check and where ? > I can map the same RBD using rbd-nbd and read sectors > from the mapped device. If I map using kernel RBD driver > (I know this is not recommended to do on the same host), > I get : > > чер 06 16:27:54 p10s kernel: rbd: image > SW_DVD9_Win_Server_STD_CORE_2016_64Bit_Russian_-4_DC_STD_MLF_X21-70539.ISO: > image uses unsupported features: 0x38 > > and > > RBD image feature set mismatch. You can disable features unsupported by the > kernel with "rbd feature disable > iso/SW_DVD9_Win_Server_STD_CORE_2016_64Bit_Russian_-4_DC_STD_MLF_X21-70539.ISO > object-map fast-diff deep-flatten". > > Probably I need to change some attributes for the RBD > to be usable with QEMU. Please give some hints. > Thank you in advance. > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Jason _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com