of the GlusterFS servers and then increased the Proxy server count. If ther=
e are any other GlusterFS servers then you can start Gluster Object Storage=
on those machines and do some load balancing over all these machines by us=
ing Pound, nginx etc. This will help reduce the cpu usage of the current ma=
chine and also utilize the other server resources.
I read the documentation and there's no mention about separating the swift/=
object-storage servers in such way. I already have a working setup, I just =
need to add more proxies.
I could, of course, setup two sets of independent servers and somehow do a =
messy data sharding between the two servers, but it's simpler and cheaper t=
o scale just the proxy servers as needed (this is almost standard procedure=
in Swift) since, from our measurements, they are the bottleneck.
There is a difference here how the swift and Gluster Object Storage work. C=
urrently, all the servers (proxy, auth, object, etc) are all coupled to eac=
h other and hence they cannot be seperated. This can be emulated by configu=
ring the setup as I mentioned above.
Hope this helps.
Thanks,
Junaid
--_000_232914239D8BEE4DB46C66AE74E75E550365A8E1mbx024e1nj10exc_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
<html dir=3D"ltr">
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Diso-8859-=
1">
<style id=3D"owaParaStyle" type=3D"text/css">P {margin-top:0;margin-bottom:=
0;}</style>
</head>
<body ocsi=3D"0" fpstyle=3D"1">
<div style=3D"direction: ltr;font-family: Tahoma;color: #000000;font-size: =
10pt;">Hi Daniel.<br>
If you want to to load balance the load on proxy server across multiple mac=
hines then you have to use load balancer, Pound is the one we have tested w=
ith, it will load balance across all the backend proxies. This is the only =
way for load balancing on proxy.<br>
If you don't want proxy and other storage (object/container/account) workin=
g on the same node/machine, as you mentioned in the latest code there is pr=
ovision to setup remote object/container/account server. Let me know if you=
are facing any issue with this.<br>
If your testing with HTTPS workload then CPU usage will be high due to SSL =
processing, we observer very low CPU usage with HTTP.<br>
<br>
Regards,<br>
Gaurav<br>
<div style=3D"font-family: Times New Roman; color: rgb(0, 0, 0); font-size:=
16px;">
<hr tabindex=3D"-1">
<div style=3D"direction: ltr;" id=3D"divRpF19051"><font color=3D"#000000" f=
ace=3D"Tahoma" size=3D"2"><b>From:</b> gluster-users-bounces at gluster.org [g=
luster-users-bounces at gluster.org] on behalf of Mohammed Junaid [junaid at glus=
ter.com]<br>
<b>Sent:</b> Friday, October 28, 2011 12:12 PM<br>
<b>To:</b> Daniel Pereira<br>
<b>Cc:</b> gluster-users at gluster.org<br>
<b>Subject:</b> Re: Gluster object-storage additional proxy=
<br>
</font><br>
</div>
<div></div>
<div>Hi Daniel,<br>
<br>
<div>Please find the comments inline.</div>
<div><br>
</div>
<div>
<div class=3D"gmail_quote">
<blockquote class=3D"gmail_quote" style=3D"margin: 0pt 0pt 0pt 0.8ex; borde=
r-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
Yes, I did that. However the CPU usage gets very high (100% for all cores) =
to have all the Gluster and Swift daemons running on the same machine. We w=
ant to separate the processes in the same manner it is already possible in =
Swift.</blockquote>
<div><br>
</div>
<div>From what I understand, you have started the Gluster Object Storage on=
one of the GlusterFS servers and then increased the Proxy server count. If=
there are any other GlusterFS servers then you can start Gluster Object St=
orage on those machines and do some
load balancing over all these machines by using Pound, nginx etc. This wil=
l help reduce the cpu usage of the current machine and also utilize the oth=
er server resources.</div>
<div><br>
</div>
<blockquote class=3D"gmail_quote" style=3D"margin: 0pt 0pt 0pt 0.8ex; borde=
r-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
I read the documentation and there's no mention about separating the swift/=
object-storage servers in such way. I already have a working setup, I just =
need to add more proxies.<br>
I could, of course, setup two sets of independent servers and somehow do a =
messy data sharding between the two servers, but it's simpler and cheaper t=
o scale just the proxy servers as needed (this is almost standard procedure=
in Swift) since, from our measurements,
they are the bottleneck.<br>
</blockquote>
<div><br>
</div>
<div>There is a difference here how the swift and Gluster Object Storage wo=
rk. Currently, all the servers (proxy, auth, object, etc) are all coupled t=
o each other and hence they cannot be seperated. This can be emulated by co=
nfiguring the setup as I mentioned
above.</div>
<div><br>
</div>
<div>Hope this helps.</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Junaid</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>
--_000_232914239D8BEE4DB46C66AE74E75E550365A8E1mbx024e1nj10exc_--
