Hello Vladimir, Please contact croit via https://www.croit.io/contact for unofficial (not yet fully reviewed) patches and mention me. They are currently working on a similar problem and have solved at least the following: * Crashes when two directories are being mirrored in parallel * Data corruption (snapshots on the destination having missing files or files "from the future") due to incorrect cache maintenance in libcephfs * Confusion that results in the failed mirroring when a directory is replaced by a symlink * Useless work done to mirror old snapshots that nobody needs, while the latest snapshot has the highest business value * Useless stat() calls slowing down the mirroring significantly * They also introduced multi-threaded mirroring so that more than one file is copied at a time and more than one subdirectory is scanned at a time - this helps with directories containing many small files Due to the above, I absolutely cannot recommend using the unpatched cephfs-mirror and would rather (if you don't want to contact croit for patches) ask you to switch to rsync with some wrapper script that runs, in parallel, multiple copies operating on different subdirectories. On Fri, Mar 21, 2025 at 12:48 AM Vladimir Cvetkovic <vladimir.cvetkovic@xxxxxxxxxxxx> wrote: > > Hi everyone, > > We have two remote clusters and are trying to set up snapshot mirroring. > Our directories are in a syncing state but never seem to actually sync the > snapshots. > Snapshot mirroring seems way to slow for large file systems - does anyone > have a working setup? > > Thanks! > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx -- Alexander Patrakov _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |