Re: Ceph RGW Performance [EXT]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



 Hi,

what is the nbproc setting on the haproxy ?

Hi,

On 25/09/2020 20:39, Dylan Griff wrote:

We have 10Gb network to our two RGW nodes behind a single ip on
haproxy, and some iperf testing shows I can push that much; latencies
look okay. However, when using a small cosbench cluster I am unable to
get more than ~250Mb of read speed total.

A few thoughts:

i) have you benchmarked your ceph itself (i.e. with rados bench - you'll want to parameter-sweep with how many clients you run (and/or threads/client))? That gives you a more useful baseline

ii) what does your RGW node load look like? On our RGW nodes we can eventually use up all the available CPU, but that required tuning both cosbench (which you look to have tried) and civetweb - rgw num rados handles and num_threads in rgw frontends

iii) is haproxy your rate-limiter? We had to significantly increase nbthread on our haproxy

HTH,

Matthew

--
The Wellcome Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE. _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxxxx unsubscribe send an email to ceph-users-leave@xxxxxxx
 Daniel Mezentsev, founder
(+1) 604 313 8592.
Soleks Data Group.
Shaping the clouds.
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux