Tested squid-3.1.18 on: Fedora 13 (2.6.33.3-85.fc13.i686.PAE) Ubuntu 8.4 (2.6.24.6) If we compile the squid with --enable-ssl option then squid process increases its memory usages fast as compare with without --enable-ssl option. Test with 2GB memory. with --enable-ssl option: around 6 times reload increases 0.1% memory. without --enable-ssl option: around 25 times reload increases 0.1% memory. Valgrind Shows: # valgrind --tool=memcheck --leak-check=full /usr/local/squid/sbin/squid -N d 10 ==17606== Memcheck, a memory error detector ==17606== Copyright (C) 2002-2009, and GNU GPL'd, by Julian Seward et al. ==17606== Using Valgrind-3.5.0 and LibVEX; rerun with -h for copyright info ==17606== Command: /usr/local/squid/sbin/squid -N d 10 ==17606== ==17606== Syscall param epoll_ctl(event) points to uninitialised byte(s) ==17606== at 0xC7753E: epoll_ctl (syscall-template.S:82) ==17606== by 0x80DB513: idnsInit (dns_internal.cc:1426) ==17606== by 0x812B479: mainInitialize() (main.cc:979) ==17606== by 0x812C33A: SquidMain(int, char**) (main.cc:1385) ==17606== by 0x812C9D2: main (main.cc:1176) ==17606== Address 0xbea2136c is on thread 1's stack ==17606== ==17606== Syscall param epoll_ctl(event) points to uninitialised byte(s) ==17606== at 0xC7753E: epoll_ctl (syscall-template.S:82) ==17606== by 0x80DB39F: idnsInit (dns_internal.cc:1431) ==17606== by 0x812B479: mainInitialize() (main.cc:979) ==17606== by 0x812C33A: SquidMain(int, char**) (main.cc:1385) ==17606== by 0x812C9D2: main (main.cc:1176) ==17606== Address 0xbea2136c is on thread 1's stack ==17606== ==17606== Warning: invalid file descriptor 1014 in syscall close() ==17606== Warning: invalid file descriptor 1015 in syscall close() ==17606== Warning: invalid file descriptor 1016 in syscall close() ==17606== Use --log-fd=<number> to select an alternative log fd. ==17606== Warning: invalid file descriptor 1017 in syscall close() ==17606== Warning: invalid file descriptor 1018 in syscall close() ==17606== Warning: invalid file descriptor 1019 in syscall close() ==17606== Warning: invalid file descriptor 1020 in syscall close() ==17606== Warning: invalid file descriptor 1021 in syscall close() ==17606== Warning: invalid file descriptor 1022 in syscall close() ==17606== Warning: invalid file descriptor 1023 in syscall close() ==17606== Syscall param epoll_ctl(event) points to uninitialised byte(s) ==17606== at 0xC7753E: epoll_ctl (syscall-template.S:82) ==17606== by 0x8177878: AcceptFD::subscribe(RefCount<AsyncCall>&) (comm.cc:2277) ==17606== by 0x81789C5: comm_accept(int, void (*)(int, int, ConnectionDetail*, comm_err_t, int, void*), void*) (comm.cc:2249) ==17606== by 0x80BAAA2: clientOpenListenSockets (client_side.cc:3575) ==17606== by 0x812A9BA: serverConnectionsOpen() (main.cc:619) ==17606== by 0x812B4D6: mainInitialize() (main.cc:1063) ==17606== by 0x812C33A: SquidMain(int, char**) (main.cc:1385) ==17606== by 0x812C9D2: main (main.cc:1176) ==17606== Address 0xbea211cc is on thread 1's stack ==17606== ==17606== Syscall param epoll_ctl(event) points to uninitialised byte(s) ==17606== at 0xC7753E: epoll_ctl (syscall-template.S:82) ==17606== by 0x80DB513: idnsInit (dns_internal.cc:1426) ==17606== by 0x812BA44: mainReconfigureFinish(void*) (main.cc:782) ==17606== by 0x8171449: AsyncCall::make() (AsyncCall.cc:34) ==17606== by 0x8173DA3: AsyncCallQueue::fireNext() (AsyncCallQueue.cc:53) ==17606== by 0x8173F27: AsyncCallQueue::fire() (AsyncCallQueue.cc:39) ==17606== by 0x80E27D9: EventLoop::runOnce() (EventLoop.cc:118) ==17606== by 0x80E290F: EventLoop::run() (EventLoop.cc:94) ==17606== by 0x812C3C2: SquidMain(int, char**) (main.cc:1418) ==17606== by 0x812C9D2: main (main.cc:1176) ==17606== Address 0xbea2123c is on thread 1's stack ==17606== ==17606== Syscall param epoll_ctl(event) points to uninitialised byte(s) ==17606== at 0xC7753E: epoll_ctl (syscall-template.S:82) ==17606== by 0x80DB39F: idnsInit (dns_internal.cc:1431) ==17606== by 0x812BA44: mainReconfigureFinish(void*) (main.cc:782) ==17606== by 0x8171449: AsyncCall::make() (AsyncCall.cc:34) ==17606== by 0x8173DA3: AsyncCallQueue::fireNext() (AsyncCallQueue.cc:53) ==17606== by 0x8173F27: AsyncCallQueue::fire() (AsyncCallQueue.cc:39) ==17606== by 0x80E27D9: EventLoop::runOnce() (EventLoop.cc:118) ==17606== by 0x80E290F: EventLoop::run() (EventLoop.cc:94) ==17606== by 0x812C3C2: SquidMain(int, char**) (main.cc:1418) ==17606== by 0x812C9D2: main (main.cc:1176) ==17606== Address 0xbea2123c is on thread 1's stack ==17606== ==17606== ==17606== HEAP SUMMARY: ==17606== in use at exit: 0 bytes in 0 blocks ==17606== total heap usage: 0 allocs, 0 frees, 0 bytes allocated ==17606== ==17606== All heap blocks were freed -- no leaks are possible ==17606== ==17606== For counts of detected and suppressed errors, rerun with: -v ==17606== Use --track-origins=yes to see where uninitialised values come from ==17606== ERROR SUMMARY: 471 errors from 5 contexts (suppressed: 25 from 10) Aborted (core dumped) Please help to locate issue. ---------------------------------------- > From: nil_fergi@xxxxxxxxxxx > To: squid-users@xxxxxxxxxxxxxxx > CC: squid3@xxxxxxxxxxxxx > Date: Fri, 20 Jan 2012 15:29:58 +0000 > Subject: Re: Squid reconfigure causes swap=0 > > > > > # ./squid -v > Squid Cache: Version 3.1.16 > configure options: > '--enable-ssl' --with-squid=/squid-3.1.16 --enable-ltdl-convenience > > Version 3.1.16 also show this problem. Let me test squid-3.1.18. > > ---------------------------------------- > > From: nil_fergi@xxxxxxxxxxx > > To: squid-users@xxxxxxxxxxxxxxx > > Date: Fri, 20 Jan 2012 10:10:01 +0000 > > Subject: Squid reconfigure causes swap=0 > > > > > > Hello, > > > > Squid reload can cause to swap=0. > > This problem can be generate by reloading (squid -k reconfigure) squid. > > After every reload it increases the memory used by squid process, if we continue its causes the swap to 0 and squid crashes. > > > > I am Using default squid configuration. > > > > ./squid -v > > Squid Cache: Version 3.1.9-20101129 > > configure > > options: '--build=i386-redhat-linux-gnu' > > '--host=i386-redhat-linux-gnu' '--target=i386-redhat-linux-gnu' > > '--enable-icap-client' '--enable-epoll' '--enable-snmp' '--enable-ssl' > > '--with-openssl=/usr/kerberos' '--enable-delay-pools' > > '--enable-linux-netfilter' '--with-pthreads' > > '--enable-digest-auth-helpers=password' '--with-winbind-auth-challenge' > > '--enable-useragent-log' '--enable-referer-log' > > '--disable-dependency-tracking' '--enable-cachemgr-hostname=localhost' > > '--enable-underscores' '--enable-cache-digests' '--enable-ident-lookups' > > '--with-large-files' '--enable-follow-x-forwarded-for' > > '--enable-wccpv2' '--enable-fd-config' '--with-maxfd=16384' > > 'build_alias=i386-redhat-linux-gnu' 'host_alias=i386-redhat-linux-gnu' > > 'target_alias=i386-redhat-linux-gnu' --with-squid=/squid-3.1.9-20101129 > > --enable-ltdl-convenience > > > > uname -r > > 2.6.33.3-85.fc13.i686.PAE > > > > Squid Version 3.1.10 also shows same behavior. > > > > valgrind (run for 3.1.10) shows as below: > > .. > > .. > > 2012/01/20 09:51:06| Reconfiguring Squid Cache (version 3.1.10)... > > 2012/01/20 09:51:06| FD 12 Closing HTTP connection > > 2012/01/20 09:51:07| Processing Configuration File: /etc/squid/squid.conf (depth 0) > > 2012/01/20 09:51:07| Initializing https proxy context > > 2012/01/20 09:51:11| Squid plugin modules loaded: 0 > > 2012/01/20 09:51:11| Adaptation support is off. > > 2012/01/20 09:51:11| Store logging disabled > > 2012/01/20 09:51:11| User-Agent logging is disabled. > > 2012/01/20 09:51:11| Referer logging is disabled. > > 2012/01/20 09:51:11| DNS Socket created at [::], FD 6 > > ==4273== Syscall param epoll_ctl(event) points to uninitialised byte(s) > > ==4273== at 0x4E1553E: epoll_ctl (in /lib/libc-2.12.2.so) > > ==4273== by 0x1EF5DB: idnsInit (in /usr/sbin/squid) > > ==4273== by 0x24DC09: ??? (in /usr/sbin/squid) > > ==4273== by 0x1F7372: AsyncCallT<EventDialer>::fire() (in /usr/sbin/squid) > > ==4273== by 0x2A90C9: AsyncCall::make() (in /usr/sbin/squid) > > ==4273== by 0x2ABA46: AsyncCallQueue::fireNext() (in /usr/sbin/squid) > > ==4273== by 0x2ABBD7: AsyncCallQueue::fire() (in /usr/sbin/squid) > > ==4273== by 0x1F774F: EventLoop::dispatchCalls() (in /usr/sbin/squid) > > ==4273== by 0x1F792C: EventLoop::runOnce() (in /usr/sbin/squid) > > ==4273== by 0x1F7A7F: EventLoop::run() (in /usr/sbin/squid) > > ==4273== by 0x24E702: SquidMain(int, char**) (in /usr/sbin/squid) > > ==4273== by 0x24EDCE: main (in /usr/sbin/squid) > > ==4273== Address 0xbe9f12fc is on thread 1's stack > > ==4273== Uninitialised value was created by a stack allocation > > ==4273== at 0x1DE161: commSetSelect (in /usr/sbin/squid) > > ==4273== > > 2012/01/20 09:51:11| DNS Socket created at 0.0.0.0, FD 7 > > ==4273== Syscall param epoll_ctl(event) points to uninitialised byte(s) > > ==4273== at 0x4E1553E: epoll_ctl (in /lib/libc-2.12.2.so) > > ==4273== by 0x1EF43D: idnsInit (in /usr/sbin/squid) > > ==4273== by 0x24DC09: ??? (in /usr/sbin/squid) > > ==4273== by 0x1F7372: AsyncCallT<EventDialer>::fire() (in /usr/sbin/squid) > > ==4273== by 0x2A90C9: AsyncCall::make() (in /usr/sbin/squid) > > ==4273== by 0x2ABA46: AsyncCallQueue::fireNext() (in /usr/sbin/squid) > > ==4273== by 0x2ABBD7: AsyncCallQueue::fire() (in /usr/sbin/squid) > > ==4273== by 0x1F774F: EventLoop::dispatchCalls() (in /usr/sbin/squid) > > ==4273== by 0x1F792C: EventLoop::runOnce() (in /usr/sbin/squid) > > ==4273== by 0x1F7A7F: EventLoop::run() (in /usr/sbin/squid) > > ==4273== by 0x24E702: SquidMain(int, char**) (in /usr/sbin/squid) > > ==4273== by 0x24EDCE: main (in /usr/sbin/squid) > > ==4273== Address 0xbe9f12fc is on thread 1's stack > > ==4273== Uninitialised value was created by a stack allocation > > ==4273== at 0x1DE161: commSetSelect (in /usr/sbin/squid) > > ==4273== > > 2012/01/20 09:51:11| Adding nameserver 192.168.38.2 from /etc/resolv.conf > > 2012/01/20 09:51:11| Accepting HTTP connections at [::]:3128, FD 9. > > 2012/01/20 09:51:11| HTCP Disabled. > > 2012/01/20 09:51:12| Loaded Icons. > > 2012/01/20 09:51:12| Ready to serve requests. > > . > > . > > . > > . > > ==4273== by 0x2ABA46: AsyncCallQueue::fireNext() (in /usr/sbin/squid) > > ==4273== by 0x2ABBD7: AsyncCallQueue::fire() (in /usr/sbin/squid) > > ==4273== by 0x1F774F: EventLoop::dispatchCalls() (in /usr/sbin/squid) > > ==4273== by 0x1F792C: EventLoop::runOnce() (in /usr/sbin/squid) > > ==4273== by 0x1F7A7F: EventLoop::run() (in /usr/sbin/squid) > > ==4273== > > ==4273== 148 bytes in 1 blocks are possibly lost in loss record 953 of 1,207 > > ==4273== at 0x4824F1B: calloc (vg_replace_malloc.c:418) > > ==4273== by 0x35734B: xcalloc (in /usr/sbin/squid) > > ==4273== by 0x350C8D: MemPoolMalloc::allocate() (in /usr/sbin/squid) > > ==4273== by 0x34ECC2: MemImplementingAllocator::alloc() (in /usr/sbin/squid) > > ==4273== by 0x1B4943: cbdataInternalAlloc(cbdata_type) (in /usr/sbin/squid) > > ==4273== by 0x1A70FA: ??? (in /usr/sbin/squid) > > ==4273== by 0x1A71E7: ??? (in /usr/sbin/squid) > > ==4273== by 0x1AC9D9: ??? (in /usr/sbin/squid) > > ==4273== by 0x1AE499: ??? (in /usr/sbin/squid) > > ==4273== by 0x1AF445: parseConfigFile(char const*) (in /usr/sbin/squid) > > ==4273== by 0x24E1FB: SquidMain(int, char**) (in /usr/sbin/squid) > > ==4273== by 0x24EDCE: main (in /usr/sbin/squid) > > ==4273== > > ==4273== 176 bytes in 2 blocks are possibly lost in loss record 956 of 1,207 > > ==4273== at 0x4824F1B: calloc (vg_replace_malloc.c:418) > > ==4273== by 0x35734B: xcalloc (in /usr/sbin/squid) > > ==4273== by 0x350C8D: MemPoolMalloc::allocate() (in /usr/sbin/squid) > > ==4273== by 0x34ECC2: MemImplementingAllocator::alloc() (in /usr/sbin/squid) > > ==4273== by 0x34F8B9: MemAllocatorProxy::alloc() (in /usr/sbin/squid) > > ==4273== by 0x2C6033: ??? (in /usr/sbin/squid) > > ==4273== by 0x2C77FD: acl_ip_data::FactoryParse(char const*) (in /usr/sbin/squid) > > ==4273== by 0x2C7904: ACLIP::parse() (in /usr/sbin/squid) > > ==4273== by 0x2E2AEA: ACL::ParseAclLine(ConfigParser&, ACL**) (in /usr/sbin/squid) > > ==4273== by 0x1ACAAE: ??? (in /usr/sbin/squid) > > ==4273== by 0x1AE499: ??? (in /usr/sbin/squid) > > ==4273== by 0x1AF445: parseConfigFile(char const*) (in /usr/sbin/squid) > > ==4273== > > ==4273== 180 bytes in 5 blocks are possibly lost in loss record 961 of 1,207 > > ==4273== at 0x4824F1B: calloc (vg_replace_malloc.c:418) > > ==4273== by 0x35734B: xcalloc (in /usr/sbin/squid) > > ==4273== by 0x350C8D: MemPoolMalloc::allocate() (in /usr/sbin/squid) > > ==4273== by 0x34ECC2: MemImplementingAllocator::alloc() (in /usr/sbin/squid) > > ==4273== by 0x24FAA8: memAllocString (in /usr/sbin/squid) > > ==4273== by 0x277C43: String::allocBuffer(unsigned int) (in /usr/sbin/squid) > > ==4273== by 0x277F3A: String::allocAndFill(char const*, int) (in /usr/sbin/squid) > > ==4273== by 0x277FD4: String::reset(char const*) (in /usr/sbin/squid) > > ==4273== by 0x278009: String::operator=(char const*) (in /usr/sbin/squid) > > ==4273== by 0x23CB92: httpHeaderBuildFieldsInfo (in /usr/sbin/squid) > > ==4273== by 0x233D28: httpHdrScInitModule() (in /usr/sbin/squid) > > ==4273== by 0x2365E1: httpHeaderInitModule (in /usr/sbin/squid) > > ==4273== > > ==4273== 202 bytes in 7 blocks are possibly lost in loss record 967 of 1,207 > > ==4273== at 0x4825BDC: malloc (vg_replace_malloc.c:195) > > ==4273== by 0x35750C: xmalloc (in /usr/sbin/squid) > > ==4273== by 0x357677: xstrdup (in /usr/sbin/squid) > > ==4273== by 0x2CC67F: aclParseAccessLine(ConfigParser&, acl_access**) (in /usr/sbin/squid) > > ==4273== by 0x19F374: ??? (in /usr/sbin/squid) > > ==4273== by 0x1ACC8F: ??? (in /usr/sbin/squid) > > ==4273== by 0x1AE499: ??? (in /usr/sbin/squid) > > ==4273== by 0x1AF445: parseConfigFile(char const*) (in /usr/sbin/squid) > > ==4273== by 0x24DB4C: ??? (in /usr/sbin/squid) > > ==4273== by 0x1F7372: AsyncCallT<EventDialer>::fire() (in /usr/sbin/squid) > > ==4273== by 0x2A90C9: AsyncCall::make() (in /usr/sbin/squid) > > ==4273== by 0x2ABA46: AsyncCallQueue::fireNext() (in /usr/sbin/squid) > > . > > . > > . > > . > > ==4273== 2,700 bytes in 75 blocks are possibly lost in loss record 1,102 of 1,207 > > ==4273== at 0x4824F1B: calloc (vg_replace_malloc.c:418) > > ==4273== by 0x35734B: xcalloc (in /usr/sbin/squid) > > ==4273== by 0x350C8D: MemPoolMalloc::allocate() (in /usr/sbin/squid) > > ==4273== by 0x34ECC2: MemImplementingAllocator::alloc() (in /usr/sbin/squid) > > ==4273== by 0x24FAA8: memAllocString (in /usr/sbin/squid) > > ==4273== by 0x277C43: String::allocBuffer(unsigned int) (in /usr/sbin/squid) > > ==4273== by 0x277F3A: String::allocAndFill(char const*, int) (in /usr/sbin/squid) > > ==4273== by 0x277FD4: String::reset(char const*) (in /usr/sbin/squid) > > ==4273== by 0x278009: String::operator=(char const*) (in /usr/sbin/squid) > > ==4273== by 0x23CB92: httpHeaderBuildFieldsInfo (in /usr/sbin/squid) > > ==4273== by 0x236665: httpHeaderInitModule (in /usr/sbin/squid) > > ==4273== by 0x24D569: ??? (in /usr/sbin/squid) > > ==4273== > > ==4273== 3,004 bytes in 1 blocks are possibly lost in loss record 1,104 of 1,207 > > ==4273== at 0x4825BDC: malloc (vg_replace_malloc.c:195) > > ==4273== by 0x35750C: xmalloc (in /usr/sbin/squid) > > ==4273== by 0x23CA9F: httpHeaderBuildFieldsInfo (in /usr/sbin/squid) > > ==4273== by 0x236665: httpHeaderInitModule (in /usr/sbin/squid) > > ==4273== by 0x24D569: ??? (in /usr/sbin/squid) > > ==4273== by 0x24E663: SquidMain(int, char**) (in /usr/sbin/squid) > > ==4273== by 0x24EDCE: main (in /usr/sbin/squid) > > ==4273== > > ==4273== 3,207 bytes in 176 blocks are definitely lost in loss record 1,107 of 1,207 > > ==4273== at 0x4825BDC: malloc (vg_replace_malloc.c:195) > > ==4273== by 0x35750C: xmalloc (in /usr/sbin/squid) > > ==4273== by 0x357677: xstrdup (in /usr/sbin/squid) > > ==4273== by 0x25458D: MimeIcon::setName(char const*) (in /usr/sbin/squid) > > ==4273== by 0x2551D2: mimeInit (in /usr/sbin/squid) > > ==4273== by 0x24DA63: ??? (in /usr/sbin/squid) > > ==4273== by 0x24E663: SquidMain(int, char**) (in /usr/sbin/squid) > > ==4273== by 0x24EDCE: main (in /usr/sbin/squid) > > ==4273== > > ==4273== 14,119 bytes in 176 blocks are definitely lost in loss record 1,158 of 1,207 > > ==4273== at 0x4825BDC: malloc (vg_replace_malloc.c:195) > > ==4273== by 0x35750C: xmalloc (in /usr/sbin/squid) > > ==4273== by 0x357677: xstrdup (in /usr/sbin/squid) > > ==4273== by 0x2545AA: MimeIcon::setName(char const*) (in /usr/sbin/squid) > > ==4273== by 0x2551D2: mimeInit (in /usr/sbin/squid) > > ==4273== by 0x24DA63: ??? (in /usr/sbin/squid) > > ==4273== by 0x24E663: SquidMain(int, char**) (in /usr/sbin/squid) > > ==4273== by 0x24EDCE: main (in /usr/sbin/squid) > > ==4273== > > ==4273== 478,537 (356 direct, 478,181 indirect) bytes in 1 blocks are definitely lost in loss record 1,207 of 1,207 > > ==4273== at 0x4825BDC: malloc (vg_replace_malloc.c:195) > > ==4273== by 0x4A84B9E: ??? (in /usr/lib/libcrypto.so.1.0.0) > > ==4273== by 0x4A851F8: CRYPTO_malloc (in /usr/lib/libcrypto.so.1.0.0) > > ==4273== by 0x4A28EF5: SSL_CTX_new (in /usr/lib/libssl.so.1.0.0) > > ==4273== > > by 0x26E32C: sslCreateClientContext(char const*, char const*, int, char > > const*, char const*, char const*, char const*, char const*, char > > const*) (in /usr/sbin/squid) > > ==4273== by 0x1AF8D3: parseConfigFile(char const*) (in /usr/sbin/squid) > > ==4273== by 0x24E1FB: SquidMain(int, char**) (in /usr/sbin/squid) > > ==4273== by 0x24EDCE: main (in /usr/sbin/squid) > > ==4273== > > ==4273== LEAK SUMMARY: > > ==4273== definitely lost: 17,924 bytes in 365 blocks > > ==4273== indirectly lost: 478,537 bytes in 16,390 blocks > > ==4273== possibly lost: 11,378 bytes in 231 blocks > > ==4273== still reachable: 3,027,964 bytes in 26,298 blocks > > ==4273== suppressed: 0 bytes in 0 blocks > > ==4273== Reachable blocks (those to which a pointer was found) are not shown. > > ==4273== To see them, rerun with: --leak-check=full --show-reachable=yes > > > > Please help me. >
