Copying large file stuck, two cephfs-2 mounts on two cluster

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Dear ceph community,



We have two ceph cluster of equal size, one main and one mirror, both using cephadm and on version

ceph version 17.2.1 (ec95624474b1871a821a912b8c3af68f8f8e7aa1) quincy (stable)



We are stuck with copying a large file (~ 64G) between the CephFS file systems of the two clusters.


The source path is a snapshot (i.e. something like /my/path/.snap/schedule_some-date/…).
But I don't think that should make any difference.



First, I was thinking that I need to adapt some rsync parameters to work better with bigger files on CephFS.

But when confirming by just copying the file with cp, the transfer get's also stuck.

Without any error message, the process just keeps running (rsync or cp).

But the file size on the target doesn't increase anymore at some point (almost 85%).



Main:

-rw------- 1 cockpit-ws printadmin 68360698297 16. Nov 13:40 LB22_2764_dragen.bam



Mirror:

-rw------- 1 root root 58099499008 22. Dez 15:54 LB22_2764_dragen.bam



Our CephFS file size limit is with 10 TB more than generous.
And as far as I know from clients there are indeed files in TB ranges on the cluster without issues.



I don't know if this is the file's fault or if this is some issue with either of the CephFS' or cluster.

And I don't know how to look and troubleshoot this.

Can anybody give me a tip where I can start looking and debug these kind of issues?



Thank you very much.



Best Wishes,

Mathias
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux