Re: Help troubleshooting performance issue, after "1000 total children" Apache no longer responds to HTTP requests. Not MaxClients issue? (Apache Users)

can you please give us the full output from Apaches scoreboard

service httpd fullstatus

(yum install elinks)

you can search/replace any private data, however the rest of the
output is very important for troubleshooting.

Sincerely,
Alexandr Normalex

On 3 May 2012 13:29, P J <pauljflists@xxxxxxxxx> wrote:
>
>
> On Thu, May 3, 2012 at 9:51 AM, Pablo Armando <pablo.armando@xxxxxxxxxxxx>
> wrote:
>>
>> What about the number of open file descriptors ??
>>
>>
>>
>> On 05/03/2012 01:33 PM, Tom Evans wrote:
>>>
>>> On Mon, Apr 30, 2012 at 4:20 PM, P J<pauljflists@xxxxxxxxx> wrote:
>>> .... The fact that your issue seems to happen when you go above 1024
>>> clients - a magic number - suggests that it may be something programatically
>>> wrong. Hope that helps!
>>
>>
> Thanks for the great feedback everyone, much appreciated.
>
> Tom: I will check the listen queue the next time this happens to see how
> large it is.
>
> Good idea about raising the limit to accommodate the peak as a starting
> point, I've switched it to:
>
> StartServers 500
> MinSpareServers 1024
> MaxSpareServers 1024
> ServerLimit 3500
> MaxClients 3500
> MaxRequestsPerChild 4000
>
> Then in the error log I'm seeing:
>
> [info] server seems busy, (you may need to increase StartServers, or
> Min/MaxSpareServers), spawning 32 children, there are 1003 idle, and 1043
> total children
>
> How can the "server seems busy" with 1003 idle children? yet it is spawning
> 32 more children? Am I totally missing something obvious here?
>
> Also a great idea to test with the 2.2.22 instead of the OS supplied 2.2.3,
> I will look into that for sure.
>
> Pablo, open file descriptors was originally what I thought the problem was,
> but I raised them from 1024 to 16384 and it made no difference:
>
> cat /proc/$(pidof -s httpd)/limits
> Limit Soft Limit Hard Limit Units
>
> Max cpu time unlimited unlimited seconds
>
> Max file size unlimited unlimited bytes
>
> Max data size unlimited unlimited bytes
>
> Max stack size 10485760 unlimited bytes
>
> Max core file size 0 unlimited bytes
>
> Max resident set unlimited unlimited bytes
>
> Max processes 55296 55296
> processes
> Max open files 16384 16384 files
>
> Max locked memory 32768 32768 bytes
>
> Max address space unlimited unlimited bytes
>
> Max file locks unlimited unlimited locks
>
> Max pending signals 55296 55296 signals
>
> Max msgqueue size 819200 819200 bytes
>
> Max nice priority 0 0
> Max realtime priority 0 0
>
> Thanks again.
>
> --
> PJ

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx
For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx

Alexandr,

Now I'm testing with:

StartServers 100

MinSpareServers 100

MaxSpareServers 120

ServerLimit 3500

MaxClients 3500

MaxRequestsPerChild 0

</IfModule>

I'd like to run service httpd fullstatus when the server is experiencing the peak traffic but it's not able to connect and times out, here is it at the moment:

Server Version: Apache/2.2.3 (CentOS)

Server Built: Feb 23 2012 21:16:56

--------------------------------------------------------------------------

Current Time: Thursday, 03-May-2012 11:36:40 PDT

Restart Time: Thursday, 03-May-2012 11:33:53 PDT

Parent Server Generation: 0

Server uptime: 2 minutes 47 seconds

Total accesses: 2347 - Total Traffic: 17.3 MB

CPU Usage: u6.99 s.61 cu0 cs0 - 4.55% CPU load

14.1 requests/sec - 106.3 kB/second - 7.6 kB/request

33 requests currently being processed, 124 idle workers

C_K____K_KC_________________C__K___K__K__C_..___.CK___________KK

________W_K_____________W_C_K____W____K____.___.________K_C_____

K_K_______C_CW__.___KKK_____K_____K.............................

................................................................

............................................

Scoreboard Key:

"_" Waiting for Connection, "S" Starting up, "R" Reading Request,

"W" Sending Reply, "K" Keepalive (read), "D" DNS Lookup,

"C" Closing connection, "L" Logging, "G" Gracefully finishing,

"I" Idle cleanup of worker, "." Open slot with no current process

Srv PID Acc M CPU SS Req Conn Child Slot Client VHost Request

0-0 6451 2/13/13 C 0.05 0 201 0.1 0.01 0.01 23.17.193.83 wwww.domain.com POST /script/ou_ar_auto2.php HTTP/1.1

1-0 6452 0/15/15 _ 0.02 12 18 0.0 0.05 0.05 74.177.135.119 wwww.domain.com POST /script/ipp.php HTTP/1.1

2-0 6453 1/16/16 K 0.02 1 78 10.9 0.39 0.39 66.87.103.41 wwww.domain.com GET

/script/forum_cat_topics_2.php?sessid=249694cdd6d7095006

3-0 6454 0/12/12 _ 0.08 5 237 0.0 0.03 0.03 174.227.130.16 wwww.domain.com POST /script/ipc.php HTTP/1.1

4-0 6455 0/14/14 _ 0.02 2 1116 0.0 0.01 0.01 82.132.239.194 wwww.domain.com POST /script/ipc.php HTTP/1.1

5-0 6456 0/16/16 _ 0.05 6 8 0.0 0.36 0.36 24.9.115.151 wwww.domain.com POST /script/ip_token_free_ipad.php HTTP/1.1

6-0 6457 0/20/20 _ 0.19 0 11 0.0 0.08 0.08 93.65.59.126 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

7-0 6458 1/12/12 K 0.15 2 1272 0.0 0.01 0.01 198.228.224.61 wwww.domain.com POST /script/ipo3.php HTTP/1.1

8-0 6459 0/20/20 _ 0.06 10 6 0.0 0.06 0.06 69.122.234.185 wwww.domain.com POST /script/forum_summary.php HTTP/1.1

9-0 6460 8/21/21 K 0.03 0 2 31.8 0.04 0.04 121.219.104.95 wwww.domain.com GET

/script/forum_user_img.php?sessid=4C06F0B816FBC77470EC7175

10-0 6461 1/14/14 C 0.03 1 147 0.0 0.31 0.31 90.224.252.198 wwww.domain.com POST /script/ipo3.php HTTP/1.1

11-0 6462 0/16/16 _ 0.05 5 214 0.0 0.06 0.06 166.205.137.79 wwww.domain.com POST /script/ipo3.php HTTP/1.1

12-0 6912 0/5/10 _ 0.01 6 6 0.0 0.01 0.01 70.72.84.174 wwww.domain.com POST /script/ipp.php HTTP/1.1

13-0 6464 0/12/12 _ 0.02 13 6 0.0 0.04 0.04 84.215.107.210 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

14-0 6465 0/19/19 _ 0.16 12 2 0.0 0.07 0.07 82.5.166.250 wwww.domain.com POST /script/ip_token.php HTTP/1.1

15-0 6466 0/15/15 _ 0.02 1 3 0.0 0.01 0.01 174.126.83.149 wwww.domain.com GET

/script/forum_user_img.php?sessid=892847f802c27fabfeb3ff

16-0 6467 0/12/12 _ 0.03 2 142 0.0 0.02 0.02 87.151.196.195 wwww.domain.com POST /script/ipo.php HTTP/1.1

17-0 6468 0/19/19 _ 0.07 0 205 0.0 0.08 0.08 213.87.128.49 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

18-0 6469 0/16/16 _ 0.05 12 179 0.0 0.02 0.02 166.147.72.17 wwww.domain.com POST /script/ou_ar_auto3.php HTTP/1.1

19-0 6470 0/26/26 _ 0.05 11 1 0.0 0.11 0.11 67.84.51.49 wwww.domain.com GET

/script/forum_user_img.php?sessid=36aadac62b50aa5ff38b12f8

20-0 6471 0/18/18 _ 0.06 8 4 0.0 0.06 0.06 166.147.72.18 wwww.domain.com POST /script/forum_summary.php HTTP/1.1

21-0 6472 0/12/12 _ 0.03 15 17 0.0 0.05 0.05 66.161.174.2 wwww.domain.com POST /script/forum_recent_posts.php HTTP/1.1

22-0 6473 0/14/14 _ 0.03 1 59 0.0 0.05 0.05 49.178.4.225 wwww.domain.com GET

/script/forum_cat_topics_2.php?sessid=ec6f38521bb736f10f

23-0 6474 0/12/12 _ 0.03 9 205 0.0 0.01 0.01 80.214.0.208 wwww.domain.com POST /script/ipo3.php HTTP/1.1

24-0 6475 0/13/13 _ 0.04 15 326 0.0 0.02 0.02 108.232.0.227 wwww.domain.com POST /script/ipo.php HTTP/1.1

25-0 6476 0/15/15 _ 0.08 10 143 0.0 0.04 0.04 77.168.198.74 wwww.domain.com POST /script/ipo3.php HTTP/1.1

26-0 6477 0/12/12 _ 0.02 3 340 0.0 0.11 0.11 71.17.13.149 wwww.domain.com POST /script/ipo3.php HTTP/1.1

27-0 6917 0/2/7 _ 0.00 9 28 0.0 0.00 0.01 173.87.45.178 wwww.domain.com POST /script/ip_token_ipad.php HTTP/1.1

28-0 6479 1/13/13 C 0.04 0 336 0.0 0.05 0.05 213.87.128.49 wwww.domain.com POST /script/ipo3.php HTTP/1.1

29-0 6480 0/20/20 _ 0.10 5 9 0.0 0.11 0.11 90.212.214.94 wwww.domain.com GET

/script/forum_topic_replies_2.php?sessid=7B4D716DA80389219

30-0 6481 0/12/12 _ 0.02 5 180 0.0 0.02 0.02 78.144.81.19 wwww.domain.com POST /script/ipc.php HTTP/1.1

31-0 6482 1/11/11 K 0.03 1 2108 0.0 0.02 0.02 78.144.81.19 wwww.domain.com POST /script/ou_ar_auto.php HTTP/1.1

32-0 6483 0/22/22 _ 0.08 8 0 0.0 0.07 0.07 216.176.65.226 wwww.domain.com GET /graphics/dotted_line.png HTTP/1.1

33-0 6484 0/15/15 _ 0.03 12 2 0.0 0.03 0.03 166.147.72.17 wwww.domain.com POST /script/ipd.php HTTP/1.1

34-0 6485 0/17/17 _ 0.12 2 40 0.0 0.11 0.11 108.92.162.50 wwww.domain.com POST /script/forum_recent_posts_2.php HTTP/1.1

35-0 6486 2/16/16 K 0.05 0 10 5.7 0.07 0.07 207.219.69.194 wwww.domain.com GET

/script/forum_all_cat.php?sessid=8edfb193d327480b3b0a31b

36-0 6918 0/1/7 _ 0.00 9 140 0.0 0.00 0.01 66.171.0.108 wwww.domain.com POST /script/ipo3.php HTTP/1.1

37-0 6488 0/12/12 _ 0.05 11 6 0.0 0.15 0.15 209.91.107.226 wwww.domain.com GET

/script/forum_topic_replies_2.php?sessid=6ba2fbe9b4f682c

38-0 6489 2/18/18 K 0.05 1 2 0.0 0.04 0.04 207.244.176.223 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

39-0 6490 0/20/20 _ 0.07 7 2 0.0 0.06 0.06 174.126.83.149 wwww.domain.com GET

/script/forum_user_img.php?sessid=892847f802c27fabfeb3ff

40-0 6491 0/14/14 _ 0.02 9 1094 0.0 0.01 0.01 190.197.57.3 wwww.domain.com POST /script/ipp.php HTTP/1.1

41-0 6492 1/15/15 C 0.04 0 113 0.1 0.07 0.07 24.228.115.104 wwww.domain.com POST /script/ipc.php HTTP/1.1

42-0 6493 0/38/38 _ 0.10 0 2 0.0 0.13 0.13 67.82.12.139 wwww.domain.com POST /script/ip_token.php HTTP/1.1

43-0 - 0/0/11 . 0.17 3 0 0.0 0.00 0.03 ::1 web1.domain.com OPTIONS * HTTP/1.0

44-0 - 0/0/14 . 0.04 12 0 0.0 0.00 0.02 ::1 web1.domain.com OPTIONS * HTTP/1.0

45-0 6496 0/17/17 _ 0.05 12 2 0.0 0.15 0.15 166.205.141.14 wwww.domain.com POST /script/ip_token.php HTTP/1.1

46-0 6497 0/16/16 _ 0.02 3 18 0.0 0.28 0.28 24.93.25.39 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

47-0 6919 0/1/3 _ 0.00 8 192 0.0 0.00 0.00 190.167.128.19 wwww.domain.com POST /script/ipo3.php HTTP/1.1

48-0 - 0/0/19 . 0.04 1 0 0.0 0.00 0.10 ::1 web1.domain.com OPTIONS * HTTP/1.0

49-0 6500 1/17/17 C 0.17 0 0 0.0 0.06 0.06 ::1 web1.domain.com OPTIONS * HTTP/1.0

50-0 6501 1/15/15 K 0.03 1 166 0.2 0.02 0.02 2.216.5.121 wwww.domain.com GET

/script/forum_topic_replies_2.php?sessid=42B5DF06C9DE9AD52

51-0 6502 0/14/14 _ 0.03 11 21 0.0 0.25 0.25 64.231.82.25 wwww.domain.com POST /script/forum_recent_posts_2.php HTTP/1.1

52-0 6503 0/13/13 _ 0.04 14 2 0.0 0.06 0.06 76.26.255.111 wwww.domain.com GET

/script/forum_user_img.php?sessid=1fc12f7d3bd237b39389fc

53-0 6504 0/11/11 _ 0.03 13 997 0.0 0.31 0.31 66.171.0.108 wwww.domain.com GET

/script/skin_img.php?sessid=B950B29F34E8028C4B7C25B366378B

54-0 6505 0/16/16 _ 0.05 2 35 0.0 0.02 0.02 174.237.65.152 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

55-0 6506 0/17/17 _ 0.06 7 31 0.0 0.07 0.07 71.0.211.157 wwww.domain.com POST /script/ipp.php HTTP/1.1

56-0 6507 0/21/21 _ 0.19 6 3 0.0 0.10 0.10 92.22.188.229 wwww.domain.com GET

/script/forum_user_img.php?sessid=8376594AFC6E389CD89439F4

57-0 6508 0/12/12 _ 0.01 8 0 0.0 0.37 0.37 216.176.65.226 wwww.domain.com GET /graphics/dotted_line.png HTTP/1.1

58-0 6509 0/12/12 _ 0.01 14 12 0.0 0.12 0.12 196.210.168.213 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

59-0 6510 0/17/17 _ 0.04 4 4 0.0 0.04 0.04 23.17.193.83 wwww.domain.com POST /script/ip_token.php HTTP/1.1

60-0 6511 0/12/12 _ 0.03 13 7 0.0 0.01 0.01 112.119.73.227 wwww.domain.com GET

/script/forum_topic_replies_2.php?sessid=0CF2D4E1A00BD4CA6

61-0 6512 0/33/33 _ 0.05 10 2 0.0 0.79 0.79 90.212.214.94 wwww.domain.com GET

/script/forum_user_img.php?sessid=7B4D716DA803892197742666

62-0 6513 1/13/13 K 0.01 1 19 0.0 0.18 0.18 67.181.33.169 wwww.domain.com POST /script/ipp.php HTTP/1.1

63-0 6514 2/22/22 K 0.04 1 52 4.9 0.46 0.46 198.228.211.140 wwww.domain.com POST /script/forum_summary.php HTTP/1.1

64-0 6920 0/1/22 _ 0.00 8 33 0.0 0.00 0.12 190.167.128.19 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

65-0 6516 0/22/22 _ 0.03 10 5 0.0 0.23 0.23 112.119.73.227 wwww.domain.com GET

/script/forum_user_img.php?sessid=0CF2D4E1A00BD4CA66CE34ED

66-0 6517 0/15/15 _ 0.07 11 2 0.0 0.05 0.05 82.132.210.56 wwww.domain.com GET

/script/forum_user_img.php?sessid=a74b9f29942b4ea49ec521

67-0 6518 0/14/14 _ 0.02 14 7 0.0 0.01 0.01 67.83.160.9 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

68-0 6921 0/1/3 _ 0.00 7 240 0.0 0.00 0.00 166.147.115.112 wwww.domain.com POST /script/ipo3.php HTTP/1.1

69-0 6520 0/15/15 _ 0.05 10 137 0.0 0.16 0.16 174.235.194.211 wwww.domain.com POST /script/ipc.php HTTP/1.1

70-0 6521 0/11/11 _ 0.04 14 48 0.0 0.01 0.01 68.96.64.19 wwww.domain.com POST /script/forum_my_posts_2.php HTTP/1.1

71-0 6522 0/21/21 _ 0.05 1 2 0.0 0.08 0.08 166.147.72.18 wwww.domain.com GET

/script/forum_user_img.php?sessid=91DDF42AFFA472F88E6478F7

72-0 6523 0/9/9 W 0.02 5 0 0.0 0.01 0.01 166.147.88.32 wwww.domain.com POST /script/ou_ar_auto3.php HTTP/1.1

73-0 6524 0/12/12 _ 0.03 10 1371 0.0 0.13 0.13 82.132.239.194 wwww.domain.com POST /script/ipo.php HTTP/1.1

74-0 6525 1/10/10 K 0.01 1 131 0.0 0.00 0.00 99.233.71.93 wwww.domain.com POST /script/ipo3.php HTTP/1.1

75-0 6526 0/20/20 _ 0.07 14 3 0.0 0.04 0.04 108.232.0.227 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

76-0 6922 0/1/2 _ 0.00 7 7 0.0 0.00 0.00 166.147.115.112 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

77-0 6528 0/16/16 _ 0.05 2 5 0.0 0.03 0.03 2.216.5.121 wwww.domain.com GET

/script/forum_topic_replies_2.php?sessid=42B5DF06C9DE9AD52

78-0 6529 0/11/11 _ 0.03 7 11 0.0 0.01 0.01 82.5.166.250 wwww.domain.com GET

/script/forum_topic_replies_2.php?sessid=8b78eb3a0aed2bbfb

79-0 6530 0/13/13 _ 0.03 13 6 0.0 0.01 0.01 68.117.135.31 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

80-0 6531 0/10/10 _ 0.03 11 101 0.0 0.02 0.02 217.200.200.243 wwww.domain.com POST /script/ipc.php HTTP/1.1

81-0 6923 0/1/10 _ 0.00 8 638 0.0 0.00 0.01 82.132.239.194 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

82-0 6533 0/10/10 _ 0.02 2 4 0.0 0.15 0.15 37.8.180.61 wwww.domain.com POST /script/ip_token.php HTTP/1.1

83-0 6534 0/11/11 _ 0.01 13 14 0.0 0.11 0.11 87.236.209.154 wwww.domain.com POST /script/ip_token.php HTTP/1.1

84-0 6535 0/13/13 _ 0.03 2 246 0.0 0.02 0.02 89.156.96.222 wwww.domain.com POST /script/ou_ar_auto3.php HTTP/1.1

85-0 6536 0/13/13 _ 0.03 15 9 0.0 0.03 0.03 87.151.196.195 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

86-0 6924 0/3/9 _ 0.01 6 12 0.0 0.01 0.03 92.25.47.221 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

87-0 6538 0/11/11 _ 0.03 8 173 0.0 0.03 0.03 198.228.227.87 wwww.domain.com POST /script/ipc.php HTTP/1.1

88-0 6539 0/11/11 W 0.10 14 0 0.0 0.01 0.01 201.141.15.154 wwww.domain.com POST /script/ipo2.php HTTP/1.1

89-0 6540 0/11/11 _ 0.03 10 5 0.0 0.02 0.02 99.41.85.192 wwww.domain.com POST /script/ipp.php HTTP/1.1

90-0 6541 1/19/19 C 0.07 1 2248 0.0 0.08 0.08 66.87.90.133 wwww.domain.com POST /script/ipo3.php HTTP/1.1

91-0 6542 0/11/11 _ 0.29 11 2 0.0 0.13 0.13 166.147.72.18 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

92-0 6543 20/29/29 K 0.06 2 2 121.8 0.12 0.12 151.66.192.29 wwww.domain.com GET

/script/forum_user_img.php?sessid=adb1b0c9cb6d785a2fa5c9

93-0 6925 0/2/11 _ 0.00 6 48 0.0 0.00 0.00 93.41.137.104 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

94-0 6545 0/10/10 _ 0.03 2 528 0.0 0.01 0.01 37.8.180.61 wwww.domain.com POST /script/ipo2.php HTTP/1.1

95-0 6546 0/22/22 _ 0.03 3 282 0.0 0.54 0.54 24.177.168.60 wwww.domain.com POST /script/ipo3.php HTTP/1.1

96-0 6547 0/14/14 _ 0.04 13 3 0.0 0.02 0.02 131.252.103.233 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

97-0 6548 4/8/8 W 0.02 74 0 9.7 0.01 0.01 174.255.51.135 wwww.domain.com POST /script/ou_ar_auto3.php HTTP/1.1

98-0 6549 0/14/14 _ 0.03 2 168 0.0 0.04 0.04 173.87.45.178 wwww.domain.com POST /script/ipc.php HTTP/1.1

99-0 6550 0/21/21 _ 0.03 9 2 0.0 0.42 0.42 80.214.0.100 wwww.domain.com POST /script/ip_token.php HTTP/1.1

100-0 6551 0/16/16 _ 0.03 3 127 0.0 0.15 0.15 24.93.25.39 wwww.domain.com POST /script/ipo.php HTTP/1.1

101-0 6926 0/1/3 _ 0.01 8 282 0.0 0.01 0.01 213.205.233.12 wwww.domain.com GET

/script/forum_cat_topics_2.php?sessid=e468aed8d04bb51451

102-0 6553 1/12/12 K 0.02 2 8743 0.0 0.30 0.30 166.205.10.70 wwww.domain.com POST /script/ipo3.php HTTP/1.1

103-0 6554 0/14/14 _ 0.16 13 147 0.0 0.03 0.03 87.236.209.154 wwww.domain.com POST /script/ipo3.php HTTP/1.1

104-0 6555 0/10/10 _ 0.03 5 41 0.0 0.01 0.01 174.227.130.16 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

105-0 6556 0/11/11 _ 0.02 12 160 0.0 0.15 0.15 166.205.141.14 wwww.domain.com POST /script/ipo3.php HTTP/1.1

106-0 6927 0/4/9 _ 0.01 6 167 0.0 0.01 0.01 174.253.22.7 wwww.domain.com POST /script/forum_summary.php HTTP/1.1

107-0 - 0/0/12 . 0.05 2 0 0.0 0.00 0.15 ::1 web1.domain.com OPTIONS * HTTP/1.0

108-0 6559 0/12/12 _ 0.01 5 16 0.0 0.00 0.00 166.205.137.79 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

109-0 6560 0/16/16 _ 0.02 1 0 0.0 0.39 0.39 174.229.138.50 wwww.domain.com GET /script/kr.php?id=123&i=hunter6.jpg HTTP/1.1

110-0 6561 0/12/12 _ 0.01 12 19 0.0 0.14 0.14 82.5.166.250 wwww.domain.com GET

/script/forum_cat_topics_2.php?sessid=8b78eb3a0aed2bbfb9f7

111-0 - 0/0/10 . 0.03 0 0 0.0 0.00 0.03 ::1 web1.domain.com OPTIONS * HTTP/1.0

112-0 6563 0/12/12 _ 0.16 6 1035 0.0 0.02 0.02 67.186.126.72 wwww.domain.com POST /script/forum_recent_posts_2.php HTTP/1.1

113-0 6564 0/11/11 _ 0.03 12 6 0.0 0.02 0.02 24.64.91.167 wwww.domain.com POST /script/ipp.php HTTP/1.1

114-0 6565 0/12/12 _ 0.04 6 402 0.0 0.03 0.03 82.132.210.146 wwww.domain.com GET /script/kip.php?id=123&i=ashley_bend2_320.jpg HTTP/1.1

115-0 6566 0/12/12 _ 0.18 3 106 0.0 0.05 0.05 65.36.45.254 wwww.domain.com GET

/script/forum_cat_topics_2.php?sessid=39bf39d349a895464b22

116-0 6567 0/11/11 _ 0.05 14 40 0.0 0.01 0.01 174.252.161.107 wwww.domain.com POST /script/ipd.php HTTP/1.1

117-0 6568 0/8/8 _ 0.02 9 64 0.0 0.04 0.04 70.241.92.51 wwww.domain.com GET

/script/forum_topic_replies_2.php?sessid=D2800DF465BE9DBDB

118-0 6928 0/1/2 _ 0.00 6 169 0.0 0.00 0.00 189.253.233.147 wwww.domain.com POST /script/ipo3.php HTTP/1.1

119-0 6570 0/31/31 _ 0.03 10 0 0.0 2.45 2.45 80.184.64.20 wwww.domain.com GET /script/kip.php?id=123&i=water_bowline5.jpg HTTP/1.1

120-0 6571 1/14/14 K 0.04 1 10 5.7 0.06 0.06 66.87.88.114 wwww.domain.com GET

/script/forum_all_cat.php?sessid=f9bfadd932bd654b97cbb50

121-0 6572 0/13/13 _ 0.05 13 13 0.0 0.03 0.03 166.147.117.119 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

122-0 6573 1/12/12 C 0.02 1 8 0.0 0.01 0.01 90.224.252.198 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

123-0 6574 0/9/9 _ 0.02 4 2 0.0 0.09 0.09 189.209.161.71 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

124-0 6575 0/13/13 _ 0.02 4 116 0.0 0.01 0.01 189.209.161.71 wwww.domain.com POST /script/ipo3.php HTTP/1.1

125-0 6576 0/11/11 _ 0.02 3 6 0.0 0.32 0.32 24.177.168.60 wwww.domain.com POST /script/ip_token.php HTTP/1.1

126-0 6577 0/12/12 _ 0.01 5 150 0.0 0.19 0.19 94.0.152.233 wwww.domain.com POST /script/ipo3.php HTTP/1.1

127-0 6578 0/18/18 _ 0.02 13 304 0.0 0.05 0.05 166.147.117.119 wwww.domain.com POST /script/ipo.php HTTP/1.1

128-0 6579 2/11/11 K 0.01 2 8976 0.1 0.01 0.01 201.141.15.154 wwww.domain.com POST /script/ipc.php HTTP/1.1

129-0 6929 0/1/2 _ 0.00 6 10 0.0 0.00 0.00 189.253.233.147 wwww.domain.com POST /script/ip_token.php HTTP/1.1

130-0 6581 4/34/34 K 0.33 1 758 29.8 0.20 0.20 67.186.126.72 wwww.domain.com POST /script/forum_recent_posts_2.php HTTP/1.1

131-0 6582 0/16/16 _ 0.04 8 11 0.0 0.16 0.16 67.234.14.192 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

132-0 6583 0/25/25 _ 0.07 3 46 0.0 0.10 0.10 68.96.64.19 wwww.domain.com GET

/script/forum_topic_replies_2.php?sessid=36ee616a91134c6

133-0 6584 0/16/16 _ 0.04 11 28 0.0 0.05 0.05 174.252.60.134 wwww.domain.com POST /script/ip_token.php HTTP/1.1

134-0 6930 0/2/3 _ 0.00 5 13 0.0 0.00 0.00 198.228.211.140 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

135-0 6586 0/13/13 _ 0.04 11 199 0.0 0.03 0.03 24.57.203.234 wwww.domain.com POST /script/ou_ar_auto2.php HTTP/1.1

136-0 6587 0/15/15 _ 0.03 11 5 0.0 0.02 0.02 96.255.206.78 wwww.domain.com POST /script/ipp.php HTTP/1.1

137-0 6588 0/22/22 _ 0.07 13 18 0.0 0.19 0.19 108.92.162.50 wwww.domain.com POST /script/forum_recent_posts_2.php HTTP/1.1

138-0 6589 4/14/14 C 0.03 0 1887 312.9 0.56 0.56 174.227.130.16 wwww.domain.com GET

/script/skin_img.php?sessid=3EA55982F141FA1AA3E99B74E9E2FC

139-0 6931 0/4/5 _ 0.00 4 20 0.0 0.01 0.01 67.186.126.72 wwww.domain.com POST /script/ip_token.php HTTP/1.1

140-0 6591 6/16/16 C 0.04 1 2 44.1 0.07 0.07 174.253.22.7 wwww.domain.com GET

/script/forum_user_img.php?sessid=9c739d305c26373626bc78cb

141-0 6592 0/16/16 W 0.04 0 0 0.0 0.03 0.03 127.0.0.1 web1.domain.com GET /server-status HTTP/1.1

142-0 6593 0/12/12 _ 0.02 6 467 0.0 0.02 0.02 166.147.72.154 wwww.domain.com POST /script/ipo3.php HTTP/1.1

143-0 6594 0/11/11 _ 0.04 9 314 0.0 0.00 0.00 174.252.75.79 wwww.domain.com POST /script/onlinedata_upload_ar_free.php HTTP/1.1

144-0 - 0/0/29 . 0.06 10 0 0.0 0.00 0.43 ::1 web1.domain.com OPTIONS * HTTP/1.0

145-0 6596 0/9/9 _ 0.03 4 295 0.0 0.01 0.01 174.254.81.111 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

146-0 6597 0/10/10 _ 0.01 1 2 0.0 0.01 0.01 166.147.72.154 wwww.domain.com POST /script/ip_token.php HTTP/1.1

147-0 6598 0/14/14 _ 0.03 11 19 0.0 0.02 0.02 174.253.22.7 wwww.domain.com GET

/script/forum_cat_topics_2.php?sessid=9c739d305c26373626bc

148-0 6599 2/18/18 K 0.08 0 129 8.8 0.07 0.07 2.216.5.121 wwww.domain.com GET

/script/forum_cat_topics_2.php?sessid=42B5DF06C9DE9AD525D8

149-0 6600 3/15/15 K 0.03 0 42 0.0 0.39 0.39 66.87.88.114 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

150-0 6601 1/14/14 K 0.03 1 3 0.0 0.15 0.15 69.122.234.185 wwww.domain.com POST /script/forum_friends_posts_2.php HTTP/1.1

151-0 6602 0/20/20 _ 0.06 12 32 0.0 0.03 0.03 2.216.5.121 wwww.domain.com POST /script/forum_summary.php HTTP/1.1

152-0 6603 0/16/16 _ 0.04 6 301 0.0 0.17 0.17 2.216.5.121 wwww.domain.com GET

/script/forum_cat_topics_2.php?sessid=42B5DF06C9DE9AD525D8

153-0 6604 0/17/17 _ 0.04 14 444 0.0 0.08 0.08 174.252.41.181 wwww.domain.com GET

/script/forum_cat_topics_2.php?sessid=11876424afc807ac3f

154-0 6605 0/10/10 _ 0.15 15 268 0.0 0.15 0.15 87.151.196.195 wwww.domain.com POST /script/ipo.php HTTP/1.1

155-0 6606 0/10/10 _ 0.03 14 24 0.0 0.02 0.02 174.252.161.107 wwww.domain.com POST /script/ip_token_free.php HTTP/1.1

156-0 6607 1/12/12 K 0.02 0 402 32.7 0.05 0.05 82.132.210.146 wwww.domain.com GET /script/kip.php?id=123&i=ashley_bend3_320.jpg HTTP/1.1

157-0 6608 0/20/20 _ 0.10 0 6557 0.0 0.10 0.10 166.147.72.155 wwww.domain.com POST /script/ou_ar_auto3.php HTTP/1.1

158-0 6609 0/13/13 _ 0.02 12 5 0.0 0.01 0.01 50.14.46.157 wwww.domain.com POST /script/ip_token.php HTTP/1.1

159-0 6610 0/11/11 _ 0.08 4 287 0.0 0.04 0.04 174.254.81.111 wwww.domain.com POST /script/ipo3.php HTTP/1.1

160-0 6611 0/15/15 _ 0.02 1 23 0.0 0.03 0.03 174.252.41.181 wwww.domain.com GET

/script/forum_topic_replies_2.php?sessid=11876424afc807a

161-0 6612 0/34/34 _ 0.08 3 3 0.0 0.15 0.15 71.245.181.60 wwww.domain.com POST /script/ipp.php HTTP/1.1

162-0 6613 1/11/11 K 0.03 1 79 9.7 0.02 0.02 65.36.45.254 wwww.domain.com GET

/script/forum_topic_replies_2.php?sessid=39bf39d349a895464

--------------------------------------------------------------------------

Srv Child Server number - generation

PID OS process ID

Acc Number of accesses this connection / this child / this slot

M Mode of operation

CPU CPU usage, number of seconds

SS Seconds since beginning of most recent request

Req Milliseconds required to process most recent request

Conn Kilobytes transferred this connection

Child Megabytes transferred this child

Slot Total megabytes transferred this slot

--------------------------------------------------------------------------

SSL/TLS Session Cache Status:

cache type: SHMCB, shared memory: 512000 bytes, current sessions: 0

sub-caches: 32, indexes per sub-cache: 133

index usage: 0%, cache usage: 0%

total sessions stored since starting: 0

total sessions expired since starting: 0

total (pre-expiry) sessions scrolled out of the cache: 0

total retrieves since starting: 0 hit, 0 miss

total removes since starting: 0 hit, 0 miss

--------------------------------------------------------------------------

Apache/2.2.3 (CentOS) Server at localhost Port 80