Re: RBD: Failed to map rbd device with data pool enabled.

[Varada Kari <Varada.Kari@xxxxxxxxxxx>]

Fio with librbd takes pool as an argument. fio arguments looks like below.

ioengine=rbd
clientname=admin
pool=rbd
rbdname=test

If we can create the rbd image in a specific pool, we can run fio without any issues. BTW i am using latest fio(built from github repo).

Varada

On Thursday 08 December 2016 01:46 PM, Nick Fisk wrote:

Fio has a direct RBD engine which uses librbd. I’ve just had a quick look at the code and I can’t see an option in the latest fio to specify datapool, but I’m not sure if librbd handles this all behind the scenes. Might be worth a try.

 

From: ceph-users [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of Aravind Ramesh
Sent: 07 December 2016 19:47
To: nick@xxxxxxxxxx; ceph-users@xxxxxxxxxxxxxx
Subject: Re: RBD: Failed to map rbd device with data pool enabled.

 

Thanks Nick,

 

I have not tried using rbd-nbd, I will give it a try. Rbd mapping is failing for the image which was created with –data-pool <ec-pool> option, so I can’t run fio or any IO on it.

 

Aravind

 

From: Nick Fisk [mailto:nick@xxxxxxxxxx]
Sent: Wednesday, December 07, 2016 6:23 PM
To: Aravind Ramesh <Aravind.Ramesh@xxxxxxxxxxx>; ceph-users@xxxxxxxxxxxxxx
Subject: RE: RBD: Failed to map rbd device with data pool enabled.

 

Hi Aravind,

 

I’ve also seen this merge on Monday and tried to create a RBD on an ecpool and also failed. Although I ended up with all my OSD’s crashing and refusing to restart. I’m going to rebuild the cluster and try again.

 

Have you tried using the rbd-nbd driver or benchmarking directly with fio for the time being so you don’t have to disable the image features?

 

From: ceph-users [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of Aravind Ramesh
Sent: 07 December 2016 11:07
To: ceph-users@xxxxxxxxxxxxxx
Subject: RBD: Failed to map rbd device with data pool enabled.

 

Hi,

 

I am seeing this failure when I try to map a rbd device with –data-pool set to a EC Pool. This is a newly merged feature, I am not sure if it is expected to work yet or I need to do something more.

Same issue is seen while mapping a rbd image from replicated pool but after disabling the new features, I was able to map it and create a filesystem on it, but rbd devices created with the option –data-pool <ec pool), I am not able to disable the features also.

=============================

ems@rack9-ems-5:~/ec-rbd/master/ceph/build$ ./bin/rbd create rbdimg_EC1 --size 1024 --pool rep_pool --data-pool aravecpool32

ems@rack9-ems-5:~/ec-rbd/master/ceph/build$

 

ems@rack9-ems-5:~/ec-rbd/master/ceph/build$ rbd ls

rbdimg_EC1

ems@rack9-ems-5:~/ec-rbd/master/ceph/build$

 

ems@rack9-ems-5:~/ec-rbd/master/ceph/build$ sudo rbd map rbdimg_EC1

rbd: sysfs write failed

rbd: map failed: (6) No such device or address

ems@rack9-ems-5:~/ec-rbd/master/ceph/build$

 

ems@rack9-ems-5:~/ec-rbd/master/ceph/build$ rbd feature disable rbdimg_EC1 exclusive-lock deep-flatten fast-diff object-map

2016-12-07 16:19:42.710095 7f6594ff9700 -1 librbd::image::RefreshRequest: Image uses unsupported features: 128

2016-12-07 16:19:42.710185 7f6587fff700 -1 librbd::image::OpenRequest: failed to refresh image: (38) Function not implemented

2016-12-07 16:19:42.785027 7f6587fff700 -1 librbd::ImageState: failed to open image: (38) Function not implemented

rbd: error opening image rbdimg_EC1: (38) Function not implemented

ems@rack9-ems-5:~/

==================================

PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify the sender by telephone or e-mail (as shown above) immediately and destroy any and all copies of this message in your possession (whether hard copies or electronically stored copies).

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com