Re: Ceph RBD 0.78 Bug or feature?

[Ирек Фасихов <malmyzh@xxxxxxxxx>]

I also added a new log in Google Drive.

https://drive.google.com/folderview?id=0BxoNLVWxzOJWX0NLV1kzQ1l3Ymc&usp=sharing

2014-03-25 12:59 GMT+04:00 Ирек Фасихов <malmyzh@xxxxxxxxx>:

Ilya, set "chooseleaf_vary_r 0", but no map rbd images.

[root@ceph01 cluster]# rbd map rbd/tst

2014-03-25 12:48:14.318167 7f44717f7760  2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring

rbd: add failed: (5) Input/output error

[root@ceph01 cluster]# cat /var/log/messages | tail

Mar 25 12:45:06 ceph01 kernel: libceph: osdc handle_map corrupt msg

Mar 25 12:45:06 ceph01 kernel: libceph: mon2 192.168.100.203:6789 session established

Mar 25 12:46:33 ceph01 kernel: libceph: client11240 fsid 10b46114-ac17-404e-99e3-69b34b85c901

Mar 25 12:46:33 ceph01 kernel: libceph: got v 13 cv 11 > 9 of ceph_pg_pool

Mar 25 12:46:33 ceph01 kernel: libceph: osdc handle_map corrupt msg

Mar 25 12:46:33 ceph01 kernel: libceph: mon2 192.168.100.203:6789 session established

Mar 25 12:48:14 ceph01 kernel: libceph: client11313 fsid 10b46114-ac17-404e-99e3-69b34b85c901

Mar 25 12:48:14 ceph01 kernel: libceph: got v 13 cv 11 > 9 of ceph_pg_pool

Mar 25 12:48:14 ceph01 kernel: libceph: osdc handle_map corrupt msg

Mar 25 12:48:14 ceph01 kernel: libceph: mon0 192.168.100.201:6789 session established

I do not really understand this error. CRUSH correct.

Thanks.

2014-03-25 12:26 GMT+04:00 Ilya Dryomov <ilya.dryomov@xxxxxxxxxxx>:

On Tue, Mar 25, 2014 at 8:38 AM, Ирек Фасихов <malmyzh@xxxxxxxxx> wrote:
> Hi, Ilya.
>
> I added the files(crushd and osddump) to a folder in GoogleDrive.
>
> https://drive.google.com/folderview?id=0BxoNLVWxzOJWX0NLV1kzQ1l3Ymc&usp=sharing

OK, so this has nothing to do with caching.  You have chooseleaf_vary_r
set to 1 in your crushmap.  This is a new crush tunable, which was
introduced long after 3.14 merge window closed.  It will be supported
starting with 3.15, until then you should be able to do

ceph osd getcrushmap -o /tmp/crush

crushtool -i /tmp/crush --set-chooseleaf_vary_r 0 -o /tmp/crush.new
ceph osd setcrushmap -i /tmp/crush.new

to disable it.

Thanks,

                Ilya

--

С уважением, Фасихов Ирек Нургаязович

Моб.: +79229045757

--

С уважением, Фасихов Ирек Нургаязович

Моб.: +79229045757

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com