Re: healing of big files

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Am Di., 14. Jan. 2020 um 10:38 Uhr schrieb vlad f halilov <vfh@xxxxxxxxx>:
Hi there. I'm trying to deploy replicated 2+1 cluster with gluster 5.5.1
(debian 10) as vm image storage for libvirt, but have an issue with
healing disconnected node. Example:
... 

4) After node5 has reconnected, healing procedure has begun, but looks
that about to entire file have transferred from synced node to unsynced,
instead just changed blocks. (ifconfig on node5 showed '        RX
packets 269790  bytes 5293724127 (4.9 GiB)) - so little less  than 5Gb
file'   I tried 'difff' mode (gluster volume set vmpool
cluster.data-self-heal-algorithm diff) but with no effect. Any idea,
whats wrong?

Actually i think diff should be working the way you expect it to, but diff is very cpu-intensive as it needs to calculate and check checksums.

I would advise you to look at the example configuration for volumes with vm-disks, it should be "/var/lib/glusterd/groups/virt". The main thing is sharding is activated ("split big files internally in many small ones") and set heal-algorithm to full.

This way heal is very fast, as it only resyncs the changed shards without the need of checksums. I use it the same way on multiple hosts, each with about 20-30 vms.

And Check the value of "features.shard-block-size", don't know what the default is atm - i use 64MB and it works quite well.

Regards.

Mika
________

Community Meeting Calendar:

APAC Schedule -
Every 2nd and 4th Tuesday at 11:30 AM IST
Bridge: https://bluejeans.com/441850968

NA/EMEA Schedule -
Every 1st and 3rd Tuesday at 01:00 PM EDT
Bridge: https://bluejeans.com/441850968

Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
https://lists.gluster.org/mailman/listinfo/gluster-users

[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux