On Fri, Nov 13, 2015 at 1:14 PM, Łukasz Jagiełło <jagiello.lukasz@xxxxxxxxx> wrote: > On Fri, Nov 13, 2015 at 1:07 PM, Yehuda Sadeh-Weinraub <yehuda@xxxxxxxxxx> > wrote: >> >> > Recently I've noticed a problem with one of our buckets: >> > >> > I cannot list or stats on a bucket: >> > #v+ >> > root@ceph-s1:~# radosgw-admin bucket stats --bucket=problematic_bucket >> > error getting bucket stats ret=-22 >> >> That's EINVAL, not ENOENT. It could mean lot's of things, e.g., >> radosgw-admin version mismatch vs. version that osds are running. Try >> to add --debug-rgw=20 --debug-ms=1 --log-to-stderr to maybe get a bit >> more info about the source of this error. > > > https://gist.github.com/ljagiello/06a4dd1f34a776e38f77 > > Result of more verbose debug. > 2015-11-13 21:10:19.160420 7fd9f91be7c0 1 -- 10.8.68.78:0/1007616 --> 10.8.42.35:6800/26514 -- osd_op(client.44897323.0:30 .dir.default.5457.9 [call rgw.bucket_list] 16.2f979b1a e172956) v4 -- ?+0 0x15f3740 con 0x15daa60 2015-11-13 21:10:19.161058 7fd9ef8a7700 1 -- 10.8.68.78:0/1007616 <== osd.12 10.8.42.35:6800/26514 6 ==== osd_op_reply(30 .dir.default.5457.9 [call] ondisk = -22 (Invalid argument)) v4 ==== 118+0+0 (3885840820 0 0) 0x7fd9c8000d50 con 0x15daa60 error getting bucket stats ret=-22 You can try taking a look at osd.12 logs. Any chance osd.12 and radosgw-admin aren't running the same major version? (more likely radosgw-admin running a newer version). >> >> You're really behind. > > > I know, we've got scheduled update for 2016 it's a big project to ensure > everything is fine. > > -- > Łukasz Jagiełło > lukasz<at>jagiello<dot>org _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com