On Mon, Dec 11, 2017 at 09:29:11AM +0000, Martin Emrich wrote: > Hi! > > Am 09.12.17, 00:19 schrieb "Robin H. Johnson" <robbat2@xxxxxxxxxx>: > > If you use 'radosgw-admin bi list', you can get a listing of the raw bucket > index. I'll bet that the objects aren't being shown at the S3 layer > because something is wrong with them. But since they are in the bi-list, > you'll get 409 BucketNotEmpty. > > Yes indeed. Running "radosgw-admin bi list" results in an incomplete 300MB JSON file, before it freezes. That's a very good starting point to debug. The bucket index is stored inside the OMAP area of a raw RADOS object. (in a filestore OSD it's in the LevelDB), I wonder if you have corruption or something else awry. How many objects were in this bucket? The number from 'bucket stats' is a good starting point. Newer versions of Jewel do report OMAP inconsistency after deep-scrub, so that would be a help in your case too. -- Robin Hugh Johnson Gentoo Linux: Dev, Infra Lead, Foundation Asst. Treasurer E-Mail : robbat2@xxxxxxxxxx GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85 GnuPG FP : 7D0B3CEB E9B85B1F 825BCECF EE05E6F6 A48F6136 _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |