0At 08:07 PM 5/2/2020, you wrote:
My two cents: 1- Do you have an encrypted filesystem on top of VDO? If yes, you will see no benefit from dedupe. 2- can you post the stats of vdostats verbose /dev/mapper/xxxxx (replace with your device) you can do something like: "vdostats -verbose /dev/mapper/xxxxxxxx | grep -B6 'save percentage' On Sat, May 2, 2020 at 9:54 PM david <david@xxxxxxxx> wrote: > Folks > > I'm looking for a solution for backups because ZFS has failed on me > too many times. In my environment, I have a large amount of data > <snip>
BTW: I think the 'saving percent' of 13 is consistent with my computation of 1.16 if one takes into account the overhead blocks. Is that true?
/dev/mapper/vdo1 : version : 28 release version : 131337 data blocks used : 783273575 overhead blocks used : 2904168 logical blocks used : 906620366 physical blocks : 1465131008 logical blocks : 9395240960 1K-blocks : 5860524032 1K-blocks used : 3144710972 1K-blocks available : 2715813060 used percent : 53 saving percent : 13 block map cache size : 134217728 write policy : async block size : 4096 completed recovery count : 0 read-only recovery count : 0 operating mode : normal recovery progress (%) : N/A compressed fragments written : 0 compressed blocks written : 0 compressed fragments in packer : 0 slab count : 2793 slabs opened : 1613 slabs reopened : 235 journal disk full count : 0 journal commits requested count : 34097873 journal entries batching : 0 journal entries started : 1880569968 journal entries writing : 0 journal entries written : 1880569968 journal entries committed : 1880569968 journal blocks batching : 0 journal blocks started : 8188291 journal blocks writing : 0 journal blocks written : 8188291 journal blocks committed : 8188291 slab journal disk full count : 0 slab journal flush count : 114673 slab journal blocked count : 0 slab journal blocks written : 746351 slab journal tail busy count : 0 slab summary blocks written : 730308 reference blocks written : 288851 block map dirty pages : 3756 block map clean pages : 29012 block map free pages : 0 block map failed pages : 0 block map incoming pages : 0 block map outgoing pages : 0 block map cache pressure : 0 block map read count : 1138077465 block map write count : 939724573 block map failed reads : 0 block map failed writes : 0 block map reclaimed : 1711 block map read outgoing : 1561 block map found in cache : 1514592207 block map discard required : 1544144 block map wait for page : 561632919 block map fetch required : 32768 block map pages loaded : 1576912 block map pages saved : 1205988 block map flush count : 1122965 dedupe advice valid : 147896569 dedupe advice stale : 225 concurrent data matches : 3387826 concurrent hash collisions : 0 invalid advice PBN count : 0 no space error count : 0 read only error count : 0 instance : 0 512 byte emulation : off current VDO IO requests in progress : 1 maximum VDO IO requests in progress : 2000 dedupe advice timeouts : 14440 flush out : 317216 write amplification ratio : 0.85 bios in read : 198353413 bios in write : 940041789 bios in discard : 0 bios in flush : 317216 bios in fua : 317215 bios in partial read : 0 bios in partial write : 0 bios in partial discard : 0 bios in partial flush : 0 bios in partial fua : 0 bios out read : 345735015 bios out write : 784844888 bios out discard : 0 bios out flush : 0 bios out fua : 0 bios meta read : 1576973 bios meta write : 14763096 bios meta discard : 0 bios meta flush : 4645639 bios meta fua : 71947 bios journal read : 0 bios journal write : 9285980 bios journal discard : 0 bios journal flush : 1169635 bios journal fua : 71946 bios page cache read : 1576912 bios page cache write : 3442890 bios page cache discard : 0 bios page cache flush : 2236902 bios page cache fua : 0 bios out completed read : 345735014 bios out completed write : 784844888 bios out completed discard : 0 bios out completed flush : 0 bios out completed fua : 0 bios meta completed read : 1576973 bios meta completed write : 12481556 bios meta completed discard : 0 bios meta completed flush : 0 bios meta completed fua : 71947 bios journal completed read : 0 bios journal completed write : 8188291 bios journal completed discard : 0 bios journal completed flush : 0 bios journal completed fua : 71946 bios page cache completed read : 1576912 bios page cache completed write : 2319925 bios page cache completed discard : 0 bios page cache completed flush : 0 bios page cache completed fua : 0 bios acknowledged read : 198353412 bios acknowledged write : 940041789 bios acknowledged discard : 0 bios acknowledged flush : 317216 bios acknowledged fua : 317215 bios acknowledged partial read : 0 bios acknowledged partial write : 0 bios acknowledged partial discard : 0 bios acknowledged partial flush : 0 bios acknowledged partial fua : 0 bios in progress read : 1 bios in progress write : 0 bios in progress discard : 0 bios in progress flush : 0 bios in progress fua : 0 read cache accesses : 0 read cache hits : 0 read cache data hits : 0 KVDO module bytes used : 2038454192 KVDO module peak bytes used : 2038461936 KVDO module bios used : 37286 KVDO module peak bio count : 37574 entries indexed : 66628855 posts found : 147900030 posts not found : 784827215 queries found : 0 queries not found : 0 updates found : 2853 updates not found : 0 current dedupe queries : 0 maximum dedupe queries : 2000
_______________________________________________ CentOS mailing list CentOS@xxxxxxxxxx https://lists.centos.org/mailman/listinfo/centos
