Hi, everyone! I am testing ceph rgw and found it upload slowly. I don't know where may be the bottleneck. OS: CentOS 6.5 Version: Ceph 0.79 Hardware: CPU: 2 * quad-core Mem: 32GB Disk: 2TB*1+3TB*11 Network: 1*1GB Ethernet NIC Ceph Cluster: My cluster was composed of 4 servers(called ceph1-4). I installed a monister, a radosgw and 11 osd in every server. So the cluster had 4 servers(ceph1-4), 4 moniter, 4 radosgw, 44 osd. I configured ceph as ceph.com's documents said and didn't do any special config. Then I use s3cmd to test the Ceph Cluster. Test 1: In ceph1, upload a big file to the rgw in ceph1.Do test several times. The speed is about 10MB/s! It's too slowly! I upload files from ceph1 to ceph1. There is not any network latency. Test 2: In ceph1, upload a big file to the rgw in ceph2.Do test several times. The speed is also about 10MB/s! Test3: In each ceph server, upload a big file to the rgw in their own rgw in the mean time.Do test several times. The speed in each ceph server is about 1-3MB/s. The sum of the speeds is about 10MB/s! I use the command "iostat -kx 3" to watch the stress of disks. When testing, the iowait is lower than 1%, and %util is lower than 1% too. There may be some problem.The speed in one server is too slowly.And the total speed didn't increase with the number of rgw. Can anyone give some suggestion? Thanks! -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140509/b035852b/attachment.htm>
 |