Search squid archive

Re: How does squid choose which cache_dir to use?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 21-Aug-07 My Secret NSA Wiretap Overheard Henrik Nordstrom Saying  :
> On tis, 2007-08-21 at 14:55 +0800, Adrian Chadd wrote:
>> It'll choose the cache dir with the least pending disk ops, if you haven't
>> configured any other restriction (min/max object size.)
> 
> No, not with aufs. They internally all share the same queue.
> 
> With aufs it currently basically selects the cache_dir based on amount
> of free space, or at least that's the idea..
> 
>> >  Normally, (when all using ufs/ffs) all the squidcache1/2/3 dirs start
>> >  filling
>> > first and the cache0 dir fills slowest. However, with the 3 using zfs,
>> > cache0
>> > is filling much faster. Is this indicitive of the 3 cache_dirs using zfs 
>> > are somehow slower, so its using cache0 more?
> 
> Odd.. the underlying filesystem should have little or no impact on how
> Squid selects cache diretory.
> 
> Regards
> Henrik

 Waah. As time goes on, it's getting even stranger. Anything I can test for or
look for?

/dev/da0s1h     39G    4.0G     31G    11%    /cache0
squidcache1    134G    3.5G    130G     3%    /squidcache1
squidcache2    134G     28G    106G    21%    /squidcache2
squidcache3    134G     14G    120G    11%    /squidcache3

-----

Server: squid/2.6.STABLE14
Date: Thu, 23 Aug 2007 02:43:15 GMT
Content-Type: text/plain
Expires: Thu, 23 Aug 2007 02:43:15 GMT
Last-Modified: Thu, 23 Aug 2007 02:43:15 GMT
X-Cache: MISS from 
Via: 1.0 server:80 (squid/2.6.STABLE14)
Connection: close

Squid Object Cache: Version 2.6.STABLE14
Start Time:     Wed, 22 Aug 2007 08:38:14 GMT
Current Time:   Thu, 23 Aug 2007 02:43:15 GMT
Connection information for squid:
        Number of clients accessing cache:      2
        Number of HTTP requests received:       3145661
        Number of ICP messages received:        1082778
        Number of ICP messages sent:    1089324
        Number of queued ICP replies:   0
        Request failure ratio:   0.00
        Average HTTP requests per minute since start:   2899.2
        Average ICP messages per minute since start:    2001.9
        Select loop called: 56871913 times, 1.145 ms avg
Cache information for squid:
        Request Hit Ratios:     5min: 80.0%, 60min: 78.0%
        Byte Hit Ratios:        5min: 85.6%, 60min: 84.4%
        Request Memory Hit Ratios:      5min: 18.4%, 60min: 18.7%
        Request Disk Hit Ratios:        5min: 67.0%, 60min: 67.6%
        Storage Swap size:      -824803418 KB
        Storage Mem size:       1024024 KB
        Mean Object Size:       -508.60 KB
        Requests given to unlinkd:      0
Median Service Times (seconds)  5 min    60 min:
        HTTP Requests (All):   0.02317  0.02317
        Cache Misses:          0.03622  0.03829
        Cache Hits:            0.01955  0.01955
        Near Hits:             0.05046  0.05046
        Not-Modified Replies:  0.02069  0.02190
        DNS Lookups:           0.00000  0.00000
        ICP Queries:           0.00085  0.00080
Resource usage for squid:
        UP Time:        65100.397 seconds
        CPU Time:       3659.457 seconds
        CPU Usage:      5.62%
        CPU Usage, 5 minute avg:        6.65%
        CPU Usage, 60 minute avg:       6.54%
        Process Data Segment Size via sbrk(): 0 KB
        Maximum Resident Size: 2426132 KB
        Page faults with physical i/o: 0
Memory accounted for:
        Total accounted:       1286613 KB
        memPoolAlloc calls: 471286106
        memPoolFree calls: 465111419
File descriptor usage for squid:
        Maximum number of file descriptors:   8192
        Largest file desc currently in use:     44
        Number of file desc currently in use:   33
        Files queued for open:                   0
        Available number of file descriptors: 8159
        Reserved number of file descriptors:   100
        Store Disk files open:                   2
        IO loop method:                     kqueue
Internal Data Structures:
        1627350 StoreEntries
         41335 StoreEntries with MemObjects
         41332 Hot Object Cache Items
        1621724 on-disk objects
HTTP/1.0 200 OK

Server: squid/2.6.STABLE14
Date: Thu, 23 Aug 2007 02:43:15 GMT
Content-Type: text/plain
Expires: Thu, 23 Aug 2007 02:43:15 GMT
Last-Modified: Thu, 23 Aug 2007 02:43:15 GMT
X-Cache: MISS from 
Via: 1.0 server:80 (squid/2.6.STABLE14)
Connection: close

Store Directory Statistics:
Store Entries          : 1627350
Maximum Swap Size      : 301056000 KB
Current Store Swap Size: -824803418 KB
Current Capacity       : -273% used, 374% free

Store Directory #0 (aufs): /cache0
FS Block Size 2048 Bytes
First level subdirectories: 32
Second level subdirectories: 128
Maximum Size: 24576000 KB
Current Size: 4084006 KB
Percent Used: 16.62%
Current load metric: 100 / 1000
Filemap bits in use: 240838 of 1048576 (23%)
Filesystem Space in use: 4201740/40393146 KB (10%)
Filesystem Inodes in use: 244969/5228542 (5%)
Flags:
Accepted object sizes: 0 - (unlimited) bytes
Removal policy: lru
LRU reference age: 1.46 days

Store Directory #1 (aufs): /squidcache1
FS Block Size 131072 Bytes
First level subdirectories: 64
Second level subdirectories: 256
Maximum Size: 92160000 KB
Current Size: 21105536 KB
Percent Used: 22.90%
Current load metric: 100 / 1000
Filemap bits in use: 164019 of 1048576 (16%)
Filesystem Space in use: 3715200/140357504 KB (3%)
Filesystem Inodes in use: 180473/1247991 (14%)
Flags:
Accepted object sizes: 0 - (unlimited) bytes
Removal policy: lru
LRU reference age: 3.10 days

Store Directory #2 (aufs): /squidcache2
FS Block Size 131072 Bytes
First level subdirectories: 64
Second level subdirectories: 256
Maximum Size: 92160000 KB
Current Size: -850102016 KB
Percent Used: -922.42%
Current load metric: 100 / 1000
Filemap bits in use: 1216017 of 2097152 (58%)
Filesystem Space in use: 28991616/140344064 KB (21%)
Filesystem Inodes in use: 1232429/2102370 (59%)
Flags: SELECTED
Accepted object sizes: 0 - (unlimited) bytes
Removal policy: lru
LRU reference age: 5.08 days

Store Directory #3 (aufs): /squidcache3
FS Block Size 131072 Bytes
First level subdirectories: 64
Second level subdirectories: 256
Maximum Size: 92160000 KB
Current Size: 109056 KB
Percent Used: 0.12%
Current load metric: 100 / 1000
Filemap bits in use: 851 of 16384 (5%)
Filesystem Space in use: 14886912/140362240 KB (11%)
Filesystem Inodes in use: 647732/1628008 (40%)
Flags:
Accepted object sizes: 0 - (unlimited) bytes
Removal policy: lru
LRU reference age: 5.08 days


 Thanks!


 Nicole


[Index of Archives]     [Linux Audio Users]     [Samba]     [Big List of Linux Books]     [Linux USB]     [Yosemite News]

  Powered by Linux