Re: Rbd map command doesn't work

EP Komarla <Ep.Komarla@xxxxxxxxxxxxxxx> · Thu, 18 Aug 2016 20:52:52 +0000

I changed the profile to Hammer and it works.  This bring up a question, by changing the profile to “Hammer” am I going to lose some of the performance optimizations done in ‘Jewel’?

- epk

From: Bruce McFarland [mailto:bkmcfarland@xxxxxxxxxxxxx]

Sent: Tuesday, August 16, 2016 4:52 PM

To: Somnath Roy <Somnath.Roy@xxxxxxxxxxx>

Cc: EP Komarla <Ep.Komarla@xxxxxxxxxxxxxxx>; ceph-users@xxxxxxxxxxxxxx

Subject: Re: [ceph-users] Rbd map command doesn't work

EP,

Try setting the crush map to use legacy tunables. I've had the same issue with the"feature mismatch" errors when using krbd that didn't support format 2 and running jewel 10.2.2 on the storage nodes. 

From the command line:

ceph osd crush tunables legacy

Bruce

On Aug 16, 2016, at 4:21 PM, Somnath Roy <Somnath.Roy@xxxxxxxxxxx> wrote:

This is usual feature mismatch stuff , the inbox krbd you are using is not supporting Jewel.
Try googling with the error and I am sure you will get lot of prior discussion around that..

From: EP Komarla [mailto:Ep.Komarla@xxxxxxxxxxxxxxx]

Sent: Tuesday, August 16, 2016 4:15 PM

To: Somnath Roy; ceph-users@xxxxxxxxxxxxxx

Subject: RE: Rbd map command doesn't work

Somnath,

Thanks.

I am trying your suggestion.  See the commands below.  Still it doesn’t seem to go.

I am missing something here…

Thanks,

- epk

=============
[test@ep-c2-client-01 ~]$ 
rbd create rbd/test1 --size 1G --image-format 1
rbd: image format 1 is deprecated
[test@ep-c2-client-01 ~]$ 
rbd map rbd/test1
rbd: sysfs write failed
In some cases useful info is found in syslog - try "dmesg | tail" or so.
rbd: map failed: (13) Permission denied
[test@ep-c2-client-01 ~]$ 
sudo rbd map rbd/test1
^C[test@ep-c2-client-01 ~]$
[test@ep-c2-client-01 ~]$
[test@ep-c2-client-01 ~]$
[test@ep-c2-client-01 ~]$
[test@ep-c2-client-01 ~]$ 
dmesg|tail -20
[1201954.248195] libceph: 
mon0 172.20.60.51:6789 feature set mismatch, my 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000
[1201954.253365] libceph: mon0 172.20.60.51:6789 missing required protocol features
[1201964.274082] libceph: mon0 172.20.60.51:6789 feature set mismatch, my 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000
[1201964.281195] libceph: mon0 172.20.60.51:6789 missing required protocol features
[1201974.298195] libceph: mon0 172.20.60.51:6789 feature set mismatch, my 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000
[1201974.305300] libceph: mon0 172.20.60.51:6789 missing required protocol features
[1204128.917562] libceph: mon0 172.20.60.51:6789 feature set mismatch, my 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000
[1204128.924173] libceph: mon0 172.20.60.51:6789 missing required protocol features
[1204138.956737] libceph: mon0 172.20.60.51:6789 feature set mismatch, my 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000
[1204138.964011] libceph: mon0 172.20.60.51:6789 missing required protocol features
[1204148.980701] libceph: mon0 172.20.60.51:6789 feature set mismatch, my 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000
[1204148.987892] libceph: mon0 172.20.60.51:6789 missing required protocol features
[1204159.004939] libceph: mon2 172.20.60.53:6789 feature set mismatch, my 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000
[1204159.012136] libceph: mon2 172.20.60.53:6789 missing required protocol features
[1204169.028802] libceph: mon0 172.20.60.51:6789 feature set mismatch, my 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000
[1204169.035992] libceph: mon0 172.20.60.51:6789 missing required protocol features
[1204476.803192] libceph: mon0 172.20.60.51:6789 feature set mismatch, my 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000
[1204476.810578] libceph: mon0 172.20.60.51:6789 missing required protocol features
[1204486.821279] libceph: mon0 172.20.60.51:6789 feature set mismatch, my 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000

From: Somnath Roy [mailto:Somnath.Roy@xxxxxxxxxxx]

Sent: Tuesday, August 16, 2016 3:59 PM

To: EP Komarla <Ep.Komarla@xxxxxxxxxxxxxxx>;
ceph-users@xxxxxxxxxxxxxx

Subject: RE: Rbd map command doesn't work

The default format of rbd image in jewel is 2 along with bunch of other deatures enabled , so, you have following two option:

1. create a format 1 image –image-format 1

2. Or, do this in the ceph.conf file [client] or [global] before creating image..
rbd_default_features = 3

Thanks & Regards
Somnath

From: ceph-users [mailto:ceph-users-bounces@xxxxxxxxxxxxxx]
On Behalf Of EP Komarla

Sent: Tuesday, August 16, 2016 2:52 PM

To: ceph-users@xxxxxxxxxxxxxx

Subject: [ceph-users] Rbd map command doesn't work

All,

I am creating an image and mapping it.  The below commands used to work in Hammer, now the same is not working in
Jewel.  I see the message about some feature set mismatch – what features are we talking about here?  Is this a known issue in Jewel with a workaround?

Thanks,

- epk

=========

[test@ep-c2-client-01 ~]$ 
rbd create rbd/test1 --size 1G
[test@ep-c2-client-01 ~]$ rbd info test1
rbd image 'test1':
        size 1024 MB in 256 objects
        order 22 (4096 kB objects)
        block_name_prefix: rbd_data.8146238e1f29
        format: 2
        features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
        flags:
[test@ep-c2-client-01 ~]$
rbd map rbd/test1
rbd: sysfs write failed
In some cases useful info is found in syslog - try "dmesg | tail" or so.
rbd: map failed: (13) Permission denied
[test@ep-c2-client-01 ~]$ dmesg|tail
[1197731.547522] libceph: mon1 172.20.60.52:6789 feature set mismatch, my 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000
[1197731.554621] libceph: mon1 172.20.60.52:6789 missing required protocol features
[1197741.571645] libceph: mon2 172.20.60.53:6789 feature set mismatch, my 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000
[1197741.578760] libceph: mon2 172.20.60.53:6789 missing required protocol features
[1198586.766120] libceph: mon1 172.20.60.52:6789 feature set mismatch, my 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000
[1198586.771248] libceph: mon1 172.20.60.52:6789 missing required protocol features
[1198596.789453] libceph: mon0 172.20.60.51:6789 feature set mismatch, my 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000
[1198596.796557] libceph: mon0 172.20.60.51:6789 missing required protocol features
[1198606.813825] libceph: mon1 172.20.60.52:6789 feature set mismatch, my 102b84a842a42 < server's 40102b84a842a42, missing 400000000000000
[1198606.820929] libceph: mon1 172.20.60.52:6789 missing required protocol features
[test@ep-c2-client-01 ~]$ sudo rbd map rbd/test1

EP KOMARLA,
<image001.png>
Emal:
EP.KOMARLA@xxxxxxxxxxxxxxx
Address: 677 Gibraltor Ct, Building #2, Milpitas, CA 94035, USA
Phone: 408-674-6090 (mobile)

Legal Disclaimer:

The information contained in this message may be privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice
 that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and delete or destroy any copy of this message!
PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message
 is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please
 notify the sender by telephone or e-mail (as shown above) immediately and destroy any and all copies of this message in your possession (whether hard copies or electronically stored copies).

Legal Disclaimer:

The information contained in this message may be privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice
 that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and delete or destroy any copy of this message!

_______________________________________________

ceph-users mailing list

ceph-users@xxxxxxxxxxxxxx

http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Legal Disclaimer:

The information contained in this message may be privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and delete or destroy any copy of this message!

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com