Re: krbd vs librbd performance with qemu

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Wed, Jul 18, 2018 at 12:36 PM Nikola Ciprich <nikola.ciprich@xxxxxxxxxxx> wrote:
;6QHi Janon,

> Just to clarify: modern / rebased krbd block drivers definitely support
> layering. The only missing features right now are object-map/fast-diff,
> deep-flatten, and journaling (for RBD mirroring).

I thought it as well, but at least mapping clone does not work for me even
under 4.17.6:


[root@v4a ~]# rbd map nvme/xxx
rbd: sysfs write failed
RBD image feature set mismatch. You can disable features unsupported by the kernel with "rbd feature disable nvme/xxx".
In some cases useful info is found in syslog - try "dmesg | tail".
rbd: map failed: (6) No such device or address

(note incorrect hint on how this is supposed to be fixed, with feature disable command without any feature)

dmesg output:

[  +3.919281] rbd: image xxx: WARNING: kernel layering is EXPERIMENTAL!
[  +0.001266] rbd: id 36dde238e1f29: image uses unsupported features: 0x38


[root@v4a ~]# rbd info nvme/xxx
rbd image 'xxx':
    size 20480 MB in 5120 objects
    order 22 (4096 kB objects)
    block_name_prefix: rbd_data.6a71313887ee0
    format: 2
    features: layering
    flags:
    create_timestamp: Wed Jun 20 13:46:38 2018
    parent: nvme/centos7@template
    overlap: 20480 MB

is trying 4.18-rc5 worth giving a try?

What's the output from "rbd info nvme/centos7"?  
 
> If you are running multiple fio jobs against the same image (or have the
> krbd device mapped to multiple hosts w/ active IO), then I would expect a
> huge performance hit since the lock needs to be transitioned between
> clients.

nope, only one running fio instance, no users on the other node..

Odd. The exclusive-lock code is only executed once (in general) upon the first write IO (or immediately upon mapping the image if the "exclusive" option is passed to the kernel). Therefore, it should have zero impact on IO performance.
 

BR

nik


--
-------------------------------------
Ing. Nikola CIPRICH
LinuxBox.cz, s.r.o.
28. rijna 168, 709 00 Ostrava

tel.:   +420 591 166 214
fax:    +420 596 621 273
mobil:  +420 777 093 799

www.linuxbox.cz

mobil servis: +420 737 238 656
email servis: servis@xxxxxxxxxxx
-------------------------------------


--
Jason
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux