Re: Cyrus doesn't preserve hard-links on replication

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Sorry for the multiples emails...
The option "provide_uuid=1" I found in my last message seems to be unrecognized by cyrus now (It's probably on by default). It's probably only useful for new messages anyway.

So I'm back to square one and my google-fu failed me. If someone know how to solve that problem any help would be greatly appreciated.

Cheers,
Adrien

Le dim. 17 nov. 2019 à 18:00, <info-cyrus-request@xxxxxxxxxxxxxxxxxxxx> a écrit :
Send Info-cyrus mailing list submissions to
        info-cyrus@xxxxxxxxxxxxxxxxxxxx

To subscribe or unsubscribe via the World Wide Web, visit
        https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
or, via email, send a message with subject or body 'help' to
        info-cyrus-request@xxxxxxxxxxxxxxxxxxxx

You can reach the person managing the list at
        info-cyrus-owner@xxxxxxxxxxxxxxxxxxxx

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Info-cyrus digest..."


Today's Topics:

   1. Cyrus doesn't preserve hard-links on replication
      (Adrien Remillieux)


----------------------------------------------------------------------

Message: 1
Date: Sun, 17 Nov 2019 13:54:11 +0100
From: Adrien Remillieux <adrien.remillieux@xxxxxxxxx>
To: info-cyrus@xxxxxxxxxxxxxxxxxxxx
Subject: Cyrus doesn't preserve hard-links on replication
Message-ID:
        <CAG-vtN=-03QQWkXGrVGjY=ak+k8Ez8LiSz+cw83G1SMzU9qFFw@xxxxxxxxxxxxxx>
Content-Type: text/plain; charset="utf-8"

Hello,

I set up replication between two cyrus servers (master runs 2.5.10 and
slave 3.0.8) with plans to decommission the old server once everything is
working. I noticed that the mail spool takes 950GB instead of ~300GB on the
old server. I suspected the hardlinks for message deduplication weren't
recreated so I ran rdfind on the mail spool and the tool found many
identical files. Is there a cyrus tool to recreate the hardlinks ? I looked
at the admin tools but I didn't find anything. Rdfind should work but it
also matched metadata such as cyrus.annotations for example. So I need to
go through the 600 mB dry-run log file to exclude unwanted files.

99% of the log file look like that : Are those safe to hardlink ?

# duptype id depth size device inode priority name
DUPTYPE_FIRST_OCCURRENCE 1030757 3 842 2065 330967752 3
/var/spool/cyrus/mail/c/user/user1/15384.
DUPTYPE_WITHIN_SAME_TREE -1030757 3 842 2065 317750405 3
/var/spool/cyrus/mail/m/user/user2/19262.
DUPTYPE_WITHIN_SAME_TREE -1030757 3 842 2065 323550741 3
/var/spool/cyrus/mail/r/user/user3/96106.
DUPTYPE_WITHIN_SAME_TREE -1030757 3 842 2065 316733834 3
/var/spool/cyrus/mail/m/user/user4/41168.
DUPTYPE_WITHIN_SAME_TREE -1030757 3 842 2065 314623377 3
/var/spool/cyrus/mail/m/user/user5/25377.
DUPTYPE_WITHIN_SAME_TREE -1030757 3 842 2065 316201219 3
/var/spool/cyrus/mail/m/user/user6/49119.
DUPTYPE_WITHIN_SAME_TREE -1030757 3 842 2065 321991878 3
/var/spool/cyrus/mail/q/user/user7/46487.

Cheers,
Adrien
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20191117/60161ca7/attachment-0001.html>

------------------------------

Subject: Digest Footer

_______________________________________________
Info-cyrus mailing list
Info-cyrus@xxxxxxxxxxxxxxxxxxxx
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus


------------------------------

End of Info-cyrus Digest, Vol 172, Issue 14
*******************************************
----
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

[Index of Archives]     [Cyrus SASL]     [Squirrel Mail]     [Asterisk PBX]     [Video For Linux]     [Photo]     [Yosemite News]     [gtk]     [KDE]     [Gimp on Windows]     [Steve's Art]

  Powered by Linux