Re: CephFS hangs when writing 10GB files in loop

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Wed, 17 Dec 2014, Wido den Hollander wrote:
> Hi,
> 
> Today I've been playing with CephFS and the morning started great with
> CephFS playing along just fine.
> 
> Some information first:
> - Ceph 0.89
> - Linux kernel 3.18
> - Ceph fuse 0.89
> - One Active MDS, one Standby
> 
> This morning I could write a 10GB file like this using the kclient:
> $ dd if=/dev/zero of=10GB.bin bs=1M count=10240 conv=fsync
> 
> That gave me 850MB/sec (all 10G network) and I could read the same file
> again with 610MB/sec.
> 
> After writing to it multiple times it suddenly started to hang.
> 
> No real evidence on the MDS (debug mds set to 20) or anything on the
> client. That specific operation just blocked, but I could still 'ls' the
> filesystem in a second terminal.
> 
> The MDS was showing in it's log that it was checking active sessions of
> clients. It showed the active session of my single client.
> 
> The client renewed it's caps and proceeded.
> 
> I currently don't have any logs, but I'm just looking for a direction to
> be pointed towards.

Hmm.  Try

 cat /sys/kernel/debug/ceph/*/mdsc
 cat /sys/kernel/debug/ceph/*/osdc

to see requests in flight (you may need to mount -t debugfs none 
/sys/kernel/debug first).  What kernel version?

sage
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html




[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]
  Powered by Linux