compacting omap doubles its size

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

I have a ceph 12.2.8 cluster on filestore with rather large omap dirs (avg size is about 150G). Recently slow requests became a problem, so after some digging I decided to convert omap from leveldb to rocksdb. Conversion went fine and slow requests rate went down to acceptable level. Unfortunately  conversion did not shrink most of omap dirs, so I tried online compaction:

Before compaction: 50G    /var/lib/ceph/osd/ceph-0/current/omap/

After compaction: 100G    /var/lib/ceph/osd/ceph-0/current/omap/

Purge and recreate: 1.5G /var/lib/ceph/osd/ceph-0/current/omap/


Before compaction: 135G    /var/lib/ceph/osd/ceph-5/current/omap/

After compaction: 260G    /var/lib/ceph/osd/ceph-5/current/omap/

Purge and recreate: 2.5G /var/lib/ceph/osd/ceph-5/current/omap/


For me compaction which makes omap bigger is quite weird and frustrating. Please help.


P.S. My cluster suffered from ongoing index reshards (it is disabled now) and on many buckets with 4m+ objects I have a lot of old indexes:

634   bucket1
651   bucket2

...
1231 bucket17
1363 bucket18


_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux