cephfs bandwidth issue

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

We are serving mp4 videos from cephfs, with lots of random read.

Here is a graph: http://elbandi.net/ceph/ceph_bandwidth.png
The issue is: there are +50% incoming bandwidth (osd -> cephfs mount, blue line) compared outgoing bandwidth (webserver -> internet, green area). the labels are swaped by the switch.

on the osd, there is a raid5 with 512k full stripe size.

Files layout on cephfs:
stripe_unit:   65536
stripe_count:  1
object_size:   524288 (== raid5 full stripe size, so one object live in one raid "block").

Why are incoming bandwidth higher than outgoing?

Elbandi
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux