We're still experiencing it with measurement-factory/bag9 repo (close to trunk minus vector refactor). No manifestations while running (large) rock store, only when using aufs. Here's some relevant gdb output: (gdb) bt #0 0x00007f68a7163425 in __GI_raise (sig=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 #1 0x00007f68a7166b8b in __GI_abort () at abort.c:91 #2 0x00000000005390cf in xassert (msg=0x7845e8 "isEmpty()", file=0x79c116 "store.cc", line=1878) at debug.cc:566 #3 0x00000000005f80bc in StoreEntry::startWriting (this=0x2cc3fb80) at store.cc:1878 #4 0x0000000000613861 in ServerStateData::setFinalReply (this=0x370fb6e58, rep=0x1a34c440) at Server.cc:180 #5 0x00000000006177a8 in noteAdaptationAclCheckDone (this=0x370fb6e58, group=...) at Server.cc:919 #6 ServerStateData::noteAdaptationAclCheckDone (this=0x370fb6e58, group=...) at Server.cc:902 #7 0x000000000070cd38 in UnaryMemFunT<Adaptation::Initiator, RefCount<Adaptation::ServiceGroup>, RefCount<Adaptation::ServiceGroup> >::doDial (this=0x36ffeb1f0) at ../../src/base/AsyncJobCalls.h:113 #8 0x000000000070ce8b in JobDialer<Adaptation::Initiator>::dial (this=0x36ffeb1f0, call=...) at ../../src/base/AsyncJobCalls.h:166 #9 0x00000000006762f9 in AsyncCall::make (this=0x36ffeb1c0) at AsyncCall.cc:32 #10 0x000000000067a24c in AsyncCallQueue::fireNext (this=<optimized out>) at AsyncCallQueue.cc:52 #11 0x000000000067a5a0 in AsyncCallQueue::fire (this=0x1126670) at AsyncCallQueue.cc:38 #12 0x0000000000549c9c in EventLoop::runOnce (this=0x7fff28173ec0) at EventLoop.cc:142 #13 0x0000000000549e50 in EventLoop::run (this=0x7fff28173ec0) at EventLoop.cc:104 #14 0x00000000005b5dd8 in SquidMain (argc=<optimized out>, argv=<optimized out>) at main.cc:1532 #15 0x00000000004d414b in SquidMainSafe (argv=<optimized out>, argc=<optimized out>) at main.cc:1260 #16 main (argc=<optimized out>, argv=<optimized out>) at main.cc:1252 (gdb) frame 3 #3 0x00000000005f80bc in StoreEntry::startWriting (this=0x2cc3fb80) at store.cc:1878 1878 store.cc: No such file or directory. (gdb) print *this $10 = {<_hash_link> = {key = 0x7b98e640, next = 0x0}, _vptr.StoreEntry = 0x79d290, mem_obj = 0x123536d0, repl = {data = 0x0}, timestamp = 1401550045, lastref = 1401550124, expires = 1401550125, lastmod = -1, swap_file_sz = 0, refcount = 1, flags = 1228, swap_filen = -1, swap_dirn = -1, mem_status = NOT_IN_MEMORY, ping_status = PING_DONE, store_status = STORE_PENDING, swap_status = SWAPOUT_NONE, cachedESITree = {p_ = 0x0}, static pool = 0x1507f70, lock_count = 4, deferredProducer = {p_ = 0x0}} (gdb) print *this->mem_obj $11 = {method = {static RequestMethodStr = <optimized out>, theMethod = Http::METHOD_GET, theImage = {static npos = 18446744073709551615, size_ = 0, len_ = 0, buf_ = 0x0}}, data_hdr = {inmem_hi = 4096, nodes = { head = 0x1d4d1e6d0, elements = 1}}, inmem_lo = 0, clients = {head = 0x3663684e8, tail = 0x3663684e8}, nclients = 1, swapout = {queue_offset = 0, sio = {p_ = 0x0}, decision = MemObject::SwapOut::swNeedsCheck}, xitTable = { index = -1, io = MemObject::ioUndecided}, memCache = {index = -1, offset = 0, io = MemObject::ioUndecided}, smpCollapsed = false, request = 0x37486e0c0, start_ping = {tv_sec = 1401550124, tv_usec = 585012}, ping_reply_callback = 0x5d1ea0 <peerHandlePingReply(CachePeer*, peer_t, AnyP::ProtocolType, void*, void*)>, ircb_data = 0x2f0e8e08, abort = {callback = 0x56e6f0 <FwdState::abort(void*)>, data = 0x247659d08}, repl = { data = 0x0}, id = 11448456, object_sz = -1, swap_hdr_sz = 0, vary_headers = 0x0, _reply = 0x1a34c440, storeId_ = {static npos = 18446744073709551615, size_ = 16384, len_ = 4369, buf_ = 0x35e102850 "http://t.skimresources.net/api/link?data=%7B%22guid%22%3A%22fa113bd91b7c236b63ad529028477253%22%2C%22pub%22%3A%2292X363%22%2C%22pag%22%3A%22http%3A%2F%2Fwww.techradar.com%2Fnews%2Fphone-and-communicat"...}, logUri_ = {static npos = 18446744073709551615, size_ = 40, len_ = 36, buf_ = 0x11646b140 "http://t.skimresources.net/api/link?"}, deferredReads = {deferredReads = {head = 0x0}}} In case you need any additional information, please let me know. HTH, Niki On Sun, Jun 1, 2014 at 8:37 AM, Amos Jeffries <squid3@xxxxxxxxxxxxx> wrote: > On 1/06/2014 5:41 a.m., Plamen wrote: >> Hi Amos, >> >> can you point out which are the patches related to the three fixes you >> mention? > > They are back in 3.2 somwehere. If you are still using such an old > version then please upgrade to the latest stable release. Which today is > 3.4.5. > > Amos >