Dear All,
Iam facing a server load of 2.0 almost all the time and a whole of
32GB of rams are consumed on the server used for squid production
My question is Why the 32GB of rams are consumed and why the server is
LOADING all the time
The squid is used in transparent mode, and cache_replacement_policy heap LFUDA
memory_replacement_policy heap GDSF
Below are some information might help you in guiding me
Thank you in advance
Cordially,
Bill
Server Specs:
Processor information: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 8 cores
Kernel and CPU: Linux 2.6.26-2-amd64 on x86_64
Memory:
total used free shared buffers cached
Mem: 32242 32077 164 0 1647 3805
-/+ buffers/cache: 26624 5618
Swap: 1898 949 949
System HD's:
/dev/sdc1 931G 304G 627G 33% /cache1
/dev/sdd1 931G 304G 628G 33% /cache2
/dev/sde1 931G 304G 628G 33% /cache3
Used in squid.conf :
cache_dir aufs /cache1 761856 16 256
cache_dir aufs /cache2 761856 16 256
cache_dir aufs /cache3 761856 16 256
Squid Object Cache: Version 2.7.STABLE9
Start Time: Sun, 26 Sep 2010 20:20:32 GMT
Current Time: Thu, 30 Sep 2010 10:22:57 GMT
Connection information for squid:
Number of clients accessing cache: 0
Number of HTTP requests received: 29432081
Number of ICP messages received: 0
Number of ICP messages sent: 0
Number of queued ICP replies: 0
Request failure ratio: 0.00
Average HTTP requests per minute since start: 5701.2
Average ICP messages per minute since start: 0.0
Select loop called: 344028563 times, 0.900 ms avg
Cache information for squid:
Request Hit Ratios: 5min: 46.2%, 60min: 44.7%
Byte Hit Ratios: 5min: 36.4%, 60min: 33.8%
Request Memory Hit Ratios: 5min: 30.2%, 60min: 31.0%
Request Disk Hit Ratios: 5min: 38.1%, 60min: 37.1%
Storage Swap size: 971763728 KB
Storage Mem size: 15728492 KB
Mean Object Size: 23.37 KB
Requests given to unlinkd: 0
Median Service Times (seconds) 5 min 60 min:
HTTP Requests (All): 0.39928 0.39928
Cache Misses: 0.85130 0.85130
Cache Hits: 0.00091 0.00000
Near Hits: 0.44492 0.42149
Not-Modified Replies: 0.00000 0.00000
DNS Lookups: 0.31806 0.31806
ICP Queries: 0.00000 0.00000
Resource usage for squid:
UP Time: 309744.817 seconds
CPU Time: 21262.145 seconds
CPU Usage: 6.86%
CPU Usage, 5 minute avg: 7.10%
CPU Usage, 60 minute avg: 6.98%
Process Data Segment Size via sbrk(): 1035968 KB
Maximum Resident Size: 0 KB
Page faults with physical i/o: 48253
Memory usage for squid via mallinfo():
Total space in arena: 275192 KB
Ordinary blocks: 270230 KB 1410 blks
Small blocks: 0 KB 0 blks
Holding blocks: 287664 KB 6 blks
Free Small blocks: 0 KB
Free Ordinary blocks: 4961 KB
Total in use: 557894 KB 99%
Total free: 4961 KB 1%
Total size: 562856 KB
Memory accounted for:
Total accounted: 23071656 KB
memPoolAlloc calls: 4165629174
memPoolFree calls: 3999994225
File descriptor usage for squid:
Maximum number of file descriptors: 8192
Largest file desc currently in use: 4007
Number of file desc currently in use: 3229
Files queued for open: 0
Available number of file descriptors: 4963
Reserved number of file descriptors: 100
Store Disk files open: 59
IO loop method: epoll
Internal Data Structures:
41658744 StoreEntries
1667360 StoreEntries with MemObjects
1665571 Hot Object Cache Items
41574469 on-disk objects
Cache Utilisation:
Last 5 minutes:
sample_start_time = 1285841897.37157 (Thu, 30 Sep 2010 10:18:17 GMT)
sample_end_time = 1285842197.40316 (Thu, 30 Sep 2010 10:23:17 GMT)
client_http.requests = 101.512264/sec
client_http.hits = 45.562854/sec
client_http.errors = 0.000000/sec
client_http.kbytes_in = 96.078988/sec
client_http.kbytes_out = 1296.996343/sec
client_http.all_median_svc_time = 0.399283 seconds
client_http.miss_median_svc_time = 0.851301 seconds
client_http.nm_median_svc_time = 0.000000 seconds
client_http.nh_median_svc_time = 0.444919 seconds
client_http.hit_median_svc_time = 0.000911 seconds
server.all.requests = 60.796026/sec
server.all.errors = 0.000000/sec
server.all.kbytes_in = 855.940987/sec
server.all.kbytes_out = 77.859180/sec
server.http.requests = 60.796026/sec
server.http.errors = 0.000000/sec
server.http.kbytes_in = 855.944320/sec
server.http.kbytes_out = 77.859180/sec
server.ftp.requests = 0.000000/sec
server.ftp.errors = 0.000000/sec
server.ftp.kbytes_in = 0.000000/sec
server.ftp.kbytes_out = 0.000000/sec
server.other.requests = 0.000000/sec
server.other.errors = 0.000000/sec
server.other.kbytes_in = 0.000000/sec
server.other.kbytes_out = 0.000000/sec
icp.pkts_sent = 0.000000/sec
icp.pkts_recv = 0.000000/sec
icp.queries_sent = 0.000000/sec
icp.replies_sent = 0.000000/sec
icp.queries_recv = 0.000000/sec
icp.replies_recv = 0.000000/sec
icp.replies_queued = 0.000000/sec
icp.query_timeouts = 0.000000/sec
icp.kbytes_sent = 0.000000/sec
icp.kbytes_recv = 0.000000/sec
icp.q_kbytes_sent = 0.000000/sec
icp.r_kbytes_sent = 0.000000/sec
icp.q_kbytes_recv = 0.000000/sec
icp.r_kbytes_recv = 0.000000/sec
icp.query_median_svc_time = 0.000000 seconds
icp.reply_median_svc_time = 0.000000 seconds
dns.median_svc_time = 0.318055 seconds
unlink.requests = 0.000000/sec
page_faults = 0.159998/sec
select_loops = 1257.813422/sec
select_fds = 1336.672592/sec
average_select_fd_period = 0.000748/fd
median_select_fds = 0.000000
swap.outs = 21.003112/sec
swap.ins = 49.239482/sec
swap.files_cleaned = 0.000000/sec
aborted_requests = 2.573306/sec
syscalls.polls = 1257.813422/sec
syscalls.disk.opens = 52.222783/sec
syscalls.disk.closes = 104.378901/sec
syscalls.disk.reads = 116.352108/sec
syscalls.disk.writes = 192.267975/sec
syscalls.disk.seeks = 0.000000/sec
syscalls.disk.unlinks = 10.159893/sec
syscalls.sock.accepts = 80.629151/sec
syscalls.sock.sockets = 27.196380/sec
syscalls.sock.connects = 27.129714/sec
syscalls.sock.binds = 27.196380/sec
syscalls.sock.closes = 67.942618/sec
syscalls.sock.reads = 604.276970/sec
syscalls.sock.writes = 673.569574/sec
syscalls.sock.recvfroms = 9.006572/sec
syscalls.sock.sendtos = 4.603285/sec
cpu_time = 22.461403 seconds
wall_time = 300.003159 seconds
cpu_usage = 7.487055%
Last 15 minutes:
sample_start_time = 1285841296.767451 (Thu, 30 Sep 2010 10:08:16 GMT)
sample_end_time = 1285842197.40316 (Thu, 30 Sep 2010 10:23:17 GMT)
client_http.requests = 103.752988/sec
client_http.hits = 47.249008/sec
client_http.errors = 0.000000/sec
client_http.kbytes_in = 101.692502/sec
client_http.kbytes_out = 1282.156827/sec
client_http.all_median_svc_time = 0.421485 seconds
client_http.miss_median_svc_time = 0.898576 seconds
client_http.nm_median_svc_time = 0.000000 seconds
client_http.nh_median_svc_time = 0.444919 seconds
client_http.hit_median_svc_time = 0.000000 seconds
server.all.requests = 61.955661/sec
server.all.errors = 0.000000/sec
server.all.kbytes_in = 858.460840/sec
server.all.kbytes_out = 83.472470/sec
server.http.requests = 61.955661/sec
server.http.errors = 0.000000/sec
server.http.kbytes_in = 858.460840/sec
server.http.kbytes_out = 83.472470/sec
server.ftp.requests = 0.000000/sec
server.ftp.errors = 0.000000/sec
server.ftp.kbytes_in = 0.000000/sec
server.ftp.kbytes_out = 0.000000/sec
server.other.requests = 0.000000/sec
server.other.errors = 0.000000/sec
server.other.kbytes_in = 0.000000/sec
server.other.kbytes_out = 0.000000/sec
icp.pkts_sent = 0.000000/sec
icp.pkts_recv = 0.000000/sec
icp.queries_sent = 0.000000/sec
icp.replies_sent = 0.000000/sec
icp.queries_recv = 0.000000/sec
icp.replies_recv = 0.000000/sec
icp.replies_queued = 0.000000/sec
icp.query_timeouts = 0.000000/sec
icp.kbytes_sent = 0.000000/sec
icp.kbytes_recv = 0.000000/sec
icp.q_kbytes_sent = 0.000000/sec
icp.r_kbytes_sent = 0.000000/sec
icp.q_kbytes_recv = 0.000000/sec
icp.r_kbytes_recv = 0.000000/sec
icp.query_median_svc_time = 0.000000 seconds
icp.reply_median_svc_time = 0.000000 seconds
dns.median_svc_time = 0.332523 seconds
unlink.requests = 0.000000/sec
page_faults = 0.283247/sec
select_loops = 1210.495220/sec
select_fds = 1305.790773/sec
average_select_fd_period = 0.000766/fd
median_select_fds = 0.000000
swap.outs = 22.723111/sec
swap.ins = 51.594357/sec
swap.files_cleaned = 0.000000/sec
aborted_requests = 2.557003/sec
syscalls.polls = 1210.495220/sec
syscalls.disk.opens = 55.269910/sec
syscalls.disk.closes = 110.417634/sec
syscalls.disk.reads = 123.492559/sec
syscalls.disk.writes = 208.668957/sec
syscalls.disk.seeks = 0.000000/sec
syscalls.disk.unlinks = 10.945570/sec
syscalls.sock.accepts = 78.552851/sec
syscalls.sock.sockets = 27.352818/sec
syscalls.sock.connects = 27.287283/sec
syscalls.sock.binds = 27.352818/sec
syscalls.sock.closes = 68.498121/sec
syscalls.sock.reads = 587.927306/sec
syscalls.sock.writes = 659.728870/sec
syscalls.sock.recvfroms = 9.038371/sec
syscalls.sock.sendtos = 4.636372/sec
cpu_time = 67.964247 seconds
wall_time = 900.272865 seconds
cpu_usage = 7.549294%
