Re: Apache Server status page shows uneven number of requests across load balanced web servers

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Thanks Gary,

The load balancing method we use is weight based, so apparently the load balancer suppose to send the traffic to the web server has least number of connections. However the Netscaler support confirmed they see eventual number of traffic routed to all 4 web servers.

Regarding the Apache restart time, I restarted all 4 servers same time and checked could still see the requests on 1 & 3 are being handled.� I dont think we have sticky session enabled at loadbalancer level.

For the same problem we have not before changed the load balancer settings from sourceIP persistence to Weight based to have the load distributed equal on all the servers.

������������������������� IP���� port�������� Type������� State��� Req/s

731-...30_80x.x.x.x�� 80�������� HTTP���������� UP���� 16/s

731-...31_80x.x.x.x�� 80�������� HTTP���������� UP���� 16/s

731-...31_80x.x.x.x�� 80�������� HTTP���������� UP���� 14/s

731-...55_80x.x.x.x�� 80�������� HTTP���������� UP���� 20/s

�������������� Rsp/s�� Reqb/s�� Rspb/s ClntConnSvrConnMaxConn�� SurgeQ

731-...30_80��� 16/s12406/s 345117/s������� 7����� 285������� 0������� 0

731-...31_80��� 16/s10956/s 365025/s������� 7����� 262������� 0������� 0

731-...31_80��� 14/s11140/s 368655/s������� 6����� 268������� 0������� 0

731-...55_80��� 20/s14322/s 420105/s������� 7����� 272������� 0������� 0


However the Apache server status still shows the number of requests being handled huge difference.


I have attached the balancer-manager page as well with this email.


Best Regards,

Arun J




On Wed, Jan 27, 2010 at 12:25 PM, Gary Smith <gary.smith@xxxxxxxxxxxxx> wrote:

Arunkumar,

There is no problem with what I see.� The load balancer will balance a requester to a machine for a period of time.� So if my web clients makes a request to your server, I will probably have a higher probability of getting that same server.� It�s like iptables connection tracking.� Load balance doesn�t necessarily mean equality service.� There is also an unfair comparison going on here.� The servers that are seeing all of the connections were restarted 1.5 days ago and the two that are working fine were started 6 days ago.� If you are going to restart and then compare, restart all of them to compare.� You mentioned that you are using weight load sharing algorithm.� It is possible that when the two servers were restarted that the balancer is trying to give them a bigger weighted share to �catch up� to the other servers.� I had a problem with this using ipvsadm some time ago when I would add a new server and give it the same schedule as the others it would be slammed for a while.

When you see a lot of connections like that, do an netstat -atunep and see what the IP address and states are.� Check to see if you have a bunch of duplicate IP�s.� If this is the case, it�s because the load balancer is gluing the connections during a session and that the IP�s are also making multiple requests.

That�s a place to start at least.

Gary Smith

From: Arunkumar Janarthanan [mailto:arunkumar.webadmin@xxxxxxxxx]
Sent: Wednesday, January 27, 2010 6:36 AM
To: users@xxxxxxxxxxxxxxxx
Subject: Apache Server status page shows uneven number of requests across load balanced web servers

Hello All,

We have apache servers running on RedHat Linux physical servers, all 4 servers are balanced by Citrix Netscaler 8.1 load balancer with round robin weight load sharing algorithm.

However when I check the server status page to find the number of requests are served by each Apache server is showing uneven load / number of requests being processed by each Apache.

I notice the load always getting processed by two specific Apache instances, here are the configuration details.

Attached here the server status screen shot page of all 4 web servers.

[root@web bin]# ./apachectl -version

Server version: Apache/2.2.6 (Unix)

Server built:�� Sep 26 2007 11:18:50

[root@web bin]#

Operating System:

Linux Host1 2.4.21-53.ELsmp #1 SMP Wed Nov 14 03:54:12 EST 2007 i686 i686 i386 GNU/Linux

Hardware configuration are same for all 4 physical Linux servers.

Please advice.

Best Regards,

Arun J


Title: Balancer Manager

Load Balancer Manager for www.PRODTC.com


LoadBalancer Status for balancer://PRODTClb1

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

5

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8109

app1_PRODTC1

 

1

0

Ok

6041

167K

257M

ajp:// Host1:8209

app1_PRODTC2

 

1

0

Ok

6047

172K

242M

ajp:// Host2:8109

app2_PRODTC1

 

1

0

Ok

6015

172K

258M

ajp:// Host2:8209

app2_PRODTC2

 

1

0

Ok

6018

156K

265M

ajp:// Host5:8109

app5_PRODTC1

 

1

0

Ok

6013

231K

235M

ajp:// Host5:8209

app5_PRODTC2

 

1

0

Ok

6028

199K

240M


LoadBalancer Status for balancer://PRODTClb2

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8309

app1_PRODTC3

 

1

0

Ok

831

14K

13M


LoadBalancer Status for balancer://PRODTCapp1

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8109

app1_PRODTC1

 

1

0

Ok

0

0

0


LoadBalancer Status for balancer://PRODTCapp2

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host2:8109

app2_PRODTC1

 

1

0

Ok

0

0

0


LoadBalancer Status for balancer://PRODTCapp5

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

1

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host5:8109

app5_PRODTC1

 

1

0

Ok

0

0

0

ajp://Host5:8209

app5_PRODTC2

 

1

0

Ok

0

0

0


LoadBalancer Status for balancer://PRODTClb-sweeps

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8309

app1_PRODTC3

 

1

0

Ok

0

0

0


LoadBalancer Status for balancer://i3c1

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

3

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8509

app1_i3c1

 

1

0

Ok

202

9.2K

4.8M

ajp://Host2:8509

app2_i3c1

 

1

0

Ok

221

7.2K

5.6M

ajp://Host5:8509

app5_i3c1

 

1

0

Ok

198

11K

5.0M

ajp://Host5:8609

app5_i3c2

 

1

0

Ok

198

8.7K

4.7M


LoadBalancer Status for balancer://PRODTClb2

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://i3c1

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://PRODTClb1

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://PRODTCapp1

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://PRODTCapp2

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://PRODTCapp5

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


Apache Server at www.PRODTC.com Port 80
Title: Balancer Manager

Load Balancer Manager for www.PRODTC.com

Server Version: Apache/2.2.6 (Unix) mod_ssl/2.2.6 hannel)?/jokes(\.do)?$ /all-jokes.do? [R=301,L] PHP/5.2.4

Server Built: Sep 26 2007 11:18:50


LoadBalancer Status for balancer://PRODTClb1

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

5

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8109

app1_PRODTC1

 

1

0

Ok

3596

109K

147M

ajp://Host1:8209

app1_PRODTC2

 

1

0

Ok

3606

104K

146M

ajp://Host2:8109

app2_PRODTC1

 

1

0

Ok

3587

100K

150M

ajp://Host2:8209

app2_PRODTC2

 

1

0

Ok

3594

100K

153M

ajp://Host5:8109

app5_PRODTC1

 

1

0

Ok

3605

178K

142M

ajp://Host5:8209

app5_PRODTC2

 

1

0

Ok

3581

101K

142M


LoadBalancer Status for balancer://PRODTClb2

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8309

app1_PRODTC3

 

1

0

Ok

504

10K

7.7M


LoadBalancer Status for balancer://PRODTCapp1

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8109

app1_PRODTC1

 

1

0

Ok

0

0

0


LoadBalancer Status for balancer://PRODTCapp2

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host2:8109

app2_PRODTC1

 

1

0

Ok

0

0

0


LoadBalancer Status for balancer://PRODTCapp5

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

1

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host5:8109

app5_PRODTC1

 

1

0

Ok

0

0

0

ajp://Host5:8209

app5_PRODTC2

 

1

0

Ok

0

0

0


LoadBalancer Status for balancer://PRODTClb-sweeps

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8309

app1_PRODTC3

 

1

0

Ok

0

0

0


LoadBalancer Status for balancer://i3c1

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

3

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8509

app1_i3c1

 

1

0

Ok

125

6.1K

2.8M

ajp://Host2:8509

app2_i3c1

 

1

0

Ok

113

4.6K

3.0M

ajp://Host5:8509

app5_i3c1

 

1

0

Ok

105

5.1K

2.5M

ajp://Host5:8609

app5_i3c2

 

1

0

Ok

106

4.4K

2.5M


LoadBalancer Status for balancer://PRODTClb2

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://i3c1

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://PRODTClb1

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://PRODTCapp1

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://PRODTCapp2

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://PRODTCapp5

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


Apache Server at www.PRODTC.com Port 80
Title: Balancer Manager

Load Balancer Manager for www.PRODTC.com

Server Version: Apache/2.2.6 (Unix) mod_ssl/2.2.6 PÞB PHP/5.2.4

Server Built: Sep 26 2007 11:18:50


LoadBalancer Status for balancer://PRODTClb1

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

5

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8109

app1_PRODTC1

 

1

0

Ok

3592

104K

146M

ajp://Host1:8209

app1_PRODTC2

 

1

0

Ok

3584

120K

146M

ajp://Host2:8109

app2_PRODTC1

 

1

0

Ok

3579

111K

145M

ajp://Host2:8209

app2_PRODTC2

 

1

0

Ok

3576

101K

154M

ajp://Host5:8109

app5_PRODTC1

 

1

0

Ok

3565

137K

142M

ajp://Host5:8209

app5_PRODTC2

 

1

0

Ok

3571

100K

143M


LoadBalancer Status for balancer://PRODTClb2

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8309

app1_PRODTC3

 

1

0

Ok

558

10K

8.8M


LoadBalancer Status for balancer://PRODTCapp1

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8109

app1_PRODTC1

 

1

0

Ok

0

0

0


LoadBalancer Status for balancer://PRODTCapp2

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host2:8109

app2_PRODTC1

 

1

0

Ok

0

0

0


LoadBalancer Status for balancer://PRODTCapp5

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

1

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host5:8109

app5_PRODTC1

 

1

0

Ok

0

0

0

ajp://Host5:8209

app5_PRODTC2

 

1

0

Ok

0

0

0


LoadBalancer Status for balancer://PRODTClb-sweeps

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8309

app1_PRODTC3

 

1

0

Ok

0

0

0


LoadBalancer Status for balancer://i3c1

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

3

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8509

app1_i3c1

 

1

0

Ok

117

5.3K

2.8M

ajp://Host2:8509

app2_i3c1

 

1

0

Ok

110

3.7K

2.5M

ajp://Host5:8509

app5_i3c1

 

1

0

Ok

106

5.9K

2.6M

ajp://Host5:8609

app5_i3c2

 

1

0

Ok

112

4.6K

2.5M


LoadBalancer Status for balancer://PRODTClb2

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://i3c1

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://PRODTClb1

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://PRODTCapp1

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://PRODTCapp2

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://PRODTCapp5

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


Apache Server at www.PRODTC.com Port 80
Title: Balancer Manager

Load Balancer Manager for www.PRODTC.com

Server Version: Apache/2.2.6 (Unix) mod_ssl/2.2.6 PHP/5.2.4

Server Built: Sep 26 2007 11:18:50


LoadBalancer Status for balancer://PRODTClb1

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

5

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8109

app1_PRODTC1

 

1

0

Ok

3392

85K

139M

ajp://Host1:8209

app1_PRODTC2

 

1

0

Ok

3371

96K

138M

ajp://Host2:8109

app2_PRODTC1

 

1

0

Ok

3378

103K

137M

ajp://Host2:8209

app2_PRODTC2

 

1

0

Ok

3362

94K

142M

ajp://Host5:8109

app5_PRODTC1

 

1

0

Ok

3374

157K

135M

ajp://Host5:8209

app5_PRODTC2

 

1

0

Ok

3375

90K

131M


LoadBalancer Status for balancer://PRODTClb2

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8309

app1_PRODTC3

 

1

0

Ok

485

9.9K

7.7M


LoadBalancer Status for balancer://PRODTCapp1

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8109

app1_PRODTC1

 

1

0

Ok

0

0

0


LoadBalancer Status for balancer://PRODTCapp2

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host2:8109

app2_PRODTC1

 

1

0

Ok

0

0

0


LoadBalancer Status for balancer://PRODTCapp5

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

1

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host5:8109

app5_PRODTC1

 

1

0

Ok

0

0

0

ajp://Host5:8209

app5_PRODTC2

 

1

0

Ok

0

0

0


LoadBalancer Status for balancer://PRODTClb-sweeps

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8309

app1_PRODTC3

 

1

0

Ok

0

0

0


LoadBalancer Status for balancer://i3c1

StickySession

Timeout

FailoverAttempts

Method

JSESSIONID

0

3

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From

ajp://Host1:8509

app1_i3c1

 

1

0

Ok

96

3.8K

2.3M

ajp://Host2:8509

app2_i3c1

 

1

0

Ok

95

2.6K

2.6M

ajp://Host5:8509

app5_i3c1

 

1

0

Ok

100

5.0K

2.4M

ajp://Host5:8609

app5_i3c2

 

1

0

Ok

96

3.6K

2.3M


LoadBalancer Status for balancer://PRODTClb2

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://i3c1

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://PRODTClb1

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://PRODTCapp1

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://PRODTCapp2

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


LoadBalancer Status for balancer://PRODTCapp5

StickySession

Timeout

FailoverAttempts

Method

 

0

0

byrequests

 

Worker URL

Route

RouteRedir

Factor

Set

Status

Elected

To

From


Apache Server at www.PRODTC.com Port 80
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx
   "   from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx
For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx

[Index of Archives]     [Open SSH Users]     [Linux ACPI]     [Linux Kernel]     [Linux Laptop]     [Kernel Newbies]     [Security]     [Netfilter]     [Bugtraq]     [Squid]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Samba]     [Video 4 Linux]     [Device Mapper]

  Powered by Linux