Thanks Mark for the response. My comments inline... To: ceph-users@xxxxxxxxxxxxxx Subject: Re: Rados bench result when increasing OSDs Message-ID: <52653B49.8090006@inktank.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed On 10/21/2013 09:13 AM, Guang Yang wrote: Dear ceph-users, Hi! Recently I deployed a ceph cluster with RadosGW, from a small one (24 OSDs) to a much bigger one (330 OSDs). Did you have the same number of concurrent requests going? [yguang] Yes. I run the test with 3 or 5 concurrent request, that does not change the result.
Forgive me if this is a silly question, but were the pools using the same level of replication? [yguang] Yes, both have 3 replicas.
You wouldn't necessarily expect a larger cluster to show higher latency if the nodes, pools, etc were all configured exactly the same, especially if you were using the same amount of concurrency. It's possible that you have some slow drives on the larger cluster that could be causing the average latency to increase. If there are more disks per node, that could do it too. [yguang] Glad to know this :) I will need to gather more information in terms of if there is any slow disk, will get back on this. Are there any other differences you can think of? [yguang] Another difference is, for the large cluster, as we expect to scale it to more than a thousand OSDs, we have a large PG number (43333) pre-created. Thanks, Guang |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
