[RadosGW] Does your RadosGW capable to handle 500+ concurrency connections?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi folks, 


There're 30 HDDs on three 24 threads severs. Each has 2 10G NICs. one for public and one for cluster . A dedicated 32threads server for RadosGW. 

My setting is to achieve same availability as Swift. So that the pool size=3 anf min_size=2.  for all RadosGW related pools. Each pool's pg is set to 2000. 

Everything is working well but performance. 

Round1) Journals all a SSD with 10 partitions on each server. 

It's faster for small object(1KB). 1100reqs/sec under concurrency=100. 
But there's a problem, the total throughPUT has only 150MB/sec. 

Round2) Journals on HDDs itself
Better throughPU in this way. The Rados Bench shows 300~400MB/sec. 
But the 1KB reqs/sec is really bad about 400reqs/sec. 

And ..... the reqs/sec reduced along with the number of concurrency. 
For example 500 concurrency can only handle 120reqs/sec. 

Dose anyone use RadosGW for high concurrency cases in real? 
Could you please let me know which http server are you running for RadosGW ? 
How will you leverage all these equipments for building a most efficiency Rados+RadosGW cluster with Swift API ? 

For reference, with same HW and similar setup, Swift can get 1600reqs/sec with 1000 concurrency. 


_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux