Search squid archive

Re: Squid with Tproxy

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



trasor wrote:
Running squid with tproxy I am seeing entries in the cache log of 'commBind: cannot bind to socket FD # to x.x.x.ip: (22) Invalid argument'. This is followed by a 'Warning: Reset of FD # for x.x.x.ip failed to bind: (22) Invalid argument'. From reading, this may be related to an end user using ftp and as such should be ok just a nuisance in the cache log. However, I am also seeing 'assertion failed: MemBuf .cc:388: "new_cap > (size_t) capacity"' whereby squid immediately restarts initialization and once initialized I start seeing the same 'commBind' entries. I understand these 'commBind' entries are occurring because squid has reinitialized and are no longer bond to the associated connections. My server has 16GB of ram and the swap is not being touched so I am not following why the 'new_cap is greater than size_t capacity'. There are also occasions where after the assertion failure occurs, squid does not restart on its own.

Squid uses dynamic-length buffers which greatly help overruns.
That assertion is showing that a buffer is being _expanded_ to a size smaller than it started. We need a stack trace to see where that shrink is occuring, it may be useful to allow shrinks, but we have yet to find a real case for it.


Another issue is dealing with Norton LiveUpdate and http1.1 Looking thru the forums I see the fix is to place http11 after the http_port, i.e. 'http_port 3129 tproxy http11'. But according to the change log that function has not been ported over from 2.7 as of yet, correct? I did run across an entry in the change details for Squid 3 Head dealing with http1.1, http://www.squid-cache.org/Versions/v3/HEAD/changesets/b9622.patch. Will this patch allow Live Updates to work?

There was a broken version of Norton LU that refused to respond to HTTP/1.0 clients. Last I heard they Norton released an updated version without that problem.


cache.log:

2009/04/12 07:56:11| assertion failed: MemBuf.cc:388: "new_cap > (size_t) capacity" 2009/04/12 07:56:14| Starting Squid Cache version 3.1.0.6 for x86_64-unknown-linux-gnu...
2009/04/12 07:56:14| Process ID 16647
2009/04/12 07:56:14| With 1024 file descriptors available
2009/04/12 07:56:14| Initializing IP Cache...
2009/04/12 07:56:14| DNS Socket created at [::], FD 7
2009/04/12 07:56:14| Adding domain lhtot.com from /etc/resolv.conf
2009/04/12 07:56:14| Adding nameserver 12.199.163.4 from /etc/resolv.conf
2009/04/12 07:56:14| Adding nameserver 74.51.162.4 from /etc/resolv.conf
2009/04/12 07:56:14| Unlinkd pipe opened on FD 12
2009/04/12 07:56:14| Store logging disabled
2009/04/12 07:56:14| Swap maxSize 1143357440 KB, estimated 87950572 objects
2009/04/12 07:56:14| Target number of buckets: 4397528
2009/04/12 07:56:14| Using 8388608 Store buckets
2009/04/12 07:56:14| Max Mem  size: 4194304 KB
2009/04/12 07:56:14| Max Swap size: 1143357440 KB
2009/04/12 07:56:14| Version 1 of swap file without LFS support detected...
2009/04/12 07:56:14| Rebuilding storage in /cache (DIRTY)
2009/04/12 07:56:14| Using Least Load store dir selection
2009/04/12 07:56:14| Set Current Directory to /cache
2009/04/12 07:56:14| Loaded Icons.
2009/04/12 07:56:14| Accepting spoofing HTTP connections at 0.0.0.0:3129, FD 15.
2009/04/12 07:56:14| HTCP Disabled.
2009/04/12 07:56:14| Squid modules loaded: 0
2009/04/12 07:56:14| Ready to serve requests.
2009/04/12 07:56:14| Store rebuilding is 0.67% complete
2009/04/12 07:56:16| Done reading /cache swaplog (610295 entries)
2009/04/12 07:56:16| Finished rebuilding storage from disk.
2009/04/12 07:56:16|    604141 Entries scanned
2009/04/12 07:56:16|         0 Invalid entries.
2009/04/12 07:56:16|         0 With invalid flags.
2009/04/12 07:56:16|    598162 Objects loaded.
2009/04/12 07:56:16|         0 Objects expired.
2009/04/12 07:56:16|      5979 Objects cancelled.
2009/04/12 07:56:16|         0 Duplicate URLs purged.
2009/04/12 07:56:16|         0 Swapfile clashes avoided.
2009/04/12 07:56:16|   Took 2.34 seconds (255507.19 objects/sec).
2009/04/12 07:56:16| Beginning Validation Procedure
2009/04/12 07:56:17|   262144 Entries Validated so far.
2009/04/12 07:56:17|   524288 Entries Validated so far.
2009/04/12 07:56:17|   786432 Entries Validated so far.
2009/04/12 07:56:17|   1048576 Entries Validated so far.
2009/04/12 07:56:17|   Completed Validation Procedure
2009/04/12 07:56:17|   Validated 1196349 Entries
2009/04/12 07:56:17|   store_swap_size = 9346436
2009/04/12 07:56:17| storeLateRelease: released 0 objects
2009/04/12 07:58:14| commBind: Cannot bind socket FD 147 to 64.201.93.245: (22) Invalid argument 2009/04/12 07:58:14| WARNING: Reset of FD 147 for 64.201.93.245 failed to bind: (22) Invalid argument 2009/04/12 07:58:14| commBind: Cannot bind socket FD 147 to 64.201.93.245: (22) Invalid argument 2009/04/12 07:58:14| WARNING: Reset of FD 147 for 64.201.93.245 failed to bind: (22) Invalid argument 2009/04/12 07:59:11| assertion failed: MemBuf.cc:388: "new_cap > (size_t) capacity" 2009/04/12 07:59:14| Starting Squid Cache version 3.1.0.6 for x86_64-unknown-linux-gnu...
2009/04/12 07:59:14| Process ID 16655
2009/04/12 07:59:14| With 1024 file descriptors available
2009/04/12 07:59:14| Initializing IP Cache...
2009/04/12 07:59:14| DNS Socket created at [::], FD 7
2009/04/12 07:59:14| Adding domain lhtot.com from /etc/resolv.conf
2009/04/12 07:59:14| Adding nameserver 12.199.163.4 from /etc/resolv.conf
2009/04/12 07:59:14| Adding nameserver 74.51.162.4 from /etc/resolv.conf
2009/04/12 07:59:14| Unlinkd pipe opened on FD 12
2009/04/12 07:59:14| Store logging disabled
2009/04/12 07:59:14| Swap maxSize 1143357440 KB, estimated 87950572 objects
2009/04/12 07:59:14| Target number of buckets: 4397528
2009/04/12 07:59:14| Using 8388608 Store buckets
2009/04/12 07:59:14| Max Mem  size: 4194304 KB
2009/04/12 07:59:14| Max Swap size: 1143357440 KB
2009/04/12 07:59:14| Version 1 of swap file without LFS support detected...
2009/04/12 07:59:14| Rebuilding storage in /cache (DIRTY)
2009/04/12 07:59:14| Using Least Load store dir selection
2009/04/12 07:59:14| Set Current Directory to /cache
2009/04/12 07:59:14| Loaded Icons.
2009/04/12 07:59:14| Accepting spoofing HTTP connections at 0.0.0.0:3129, FD 15.
2009/04/12 07:59:14| HTCP Disabled.
2009/04/12 07:59:14| Squid modules loaded: 0
2009/04/12 07:59:14| Ready to serve requests.
2009/04/12 07:59:14| Store rebuilding is 0.67% complete
2009/04/12 07:59:17| Done reading /cache swaplog (610453 entries)
2009/04/12 07:59:17| Finished rebuilding storage from disk.
2009/04/12 07:59:17|    604425 Entries scanned
2009/04/12 07:59:17|         0 Invalid entries.
2009/04/12 07:59:17|         0 With invalid flags.
2009/04/12 07:59:17|    598410 Objects loaded.
2009/04/12 07:59:17|         0 Objects expired.
2009/04/12 07:59:17|      6015 Objects cancelled.
2009/04/12 07:59:17|         0 Duplicate URLs purged.
2009/04/12 07:59:17|         0 Swapfile clashes avoided.
2009/04/12 07:59:17|   Took 2.31 seconds (259052.62 objects/sec).
2009/04/12 07:59:17| Beginning Validation Procedure
2009/04/12 07:59:17|   262144 Entries Validated so far.
2009/04/12 07:59:17|   524288 Entries Validated so far.
2009/04/12 07:59:17|   786432 Entries Validated so far.
2009/04/12 07:59:17|   1048576 Entries Validated so far.
2009/04/12 07:59:17|   Completed Validation Procedure
2009/04/12 07:59:17|   Validated 1196845 Entries
2009/04/12 07:59:17|   store_swap_size = 9351900
2009/04/12 07:59:17| storeLateRelease: released 0 objects
2009/04/12 07:59:43| assertion failed: MemBuf.cc:388: "new_cap > (size_t) capacity" 2009/04/12 07:59:46| Starting Squid Cache version 3.1.0.6 for x86_64-unknown-linux-gnu...

Thanks,

Tom


--
Please be using
  Current Stable Squid 2.7.STABLE6 or 3.0.STABLE14
  Current Beta Squid 3.1.0.7

[Index of Archives]     [Linux Audio Users]     [Samba]     [Big List of Linux Books]     [Linux USB]     [Yosemite News]

  Powered by Linux