Re: imap clients say i have 4K messages but spool has 12894 files

Ken Murchison <murch@xxxxxxxxxxxx> · Wed, 3 Jun 2020 19:35:36 -0400



    Brian,
    Trying running 'unexpunge -l' on the mailbox in question.  This
      will list expunged, but not-yet-removed-from-disk messages.
    cyr_expire is used to removed expunged messages from disk.

    
    On 6/3/20 7:30 PM, Ian Willis wrote:

    
      Hi Brian,
      

      The answer to your question is that yes, UID appears to
        correlate with the message file name. 
      At a guess something appears significantly awry.
      

      To resolve the immediate issue.
      Have you tried create a separate mail user. Copy your
        existing message over via imap to the new folder. 
      Delete and expunge the original mailbox and recreate, recopy.
      

      In the longer term I would be tempted to move to a newer
        version of cyrus or if you have the patience closely monitor the
        file-system to debug how this is occurring.
      

      Kind Regards 
      Ian
      

      -----Original Message-----
      From: Brian J. Murrell <brian@xxxxxxxxxxxxxxx>
      To: info-cyrus@xxxxxxxxxxxxxxxxxxxx
      Subject: Re: imap clients say i have 4K messages but
        spool has 12894 files
      Date: Mon, 01 Jun 2020 21:45:42 -0400
      

      On Tue, 2020-05-26 at 09:33 -0400, Brian J. Murrell wrote:
      Hi.
      
      Every IMAP client I query my cyrus imapd 2.4.17 server with says I
      have
      ~4K messages in my INBOX.  However when I do a listing of
      /var/spool/imap/b/user/brian/ it shows almost 13K files.
      
      None of these include messages which have been deleted but not
      expunged.  I manually expunge my mailbox many times per day.
      
      If I'm understanding mbexamine's output correctly, I have files on
      disk
      that are not being displayed by mbexmine.  My understanding of
      mbexamine's output is that on a line formatted as such:
      
      000001> UID:00089183   INT_DATE:[redacted] SENTDATE:[redacted]
      SIZE:1537  
      
      that the 00089183 is the reference to the file on the spool in
      /var/spool/imap/b/user/brian/89183.
      
      
      Is that correct?  If so, I definitely have files on the disk which
      are
      not found in any "000001> UID" line from mbexamine.  ~9600 of them. 
      That seems to make up the difference between what an IMAP client sees
      and how many files are on disk.
      
      I also have multiple occurrences of the same "000001> UID:" and where
      there are no matching files on the disk.  Should that be possible?
      
      So how come the huge discrepancies and how do I reconcile them?
      
      No other thoughts on how I can reconcile this gross discrepancy?
      
      Ultimately I have an IMAP spool that is growing without bound due to
      messages continuing to live on the spool beyond their life in the index
      and getting orphaned.
      
      Cheers,
      b.
      
      
      ----
      Cyrus Home Page: http://www.cyrusimap.org/
      List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
      To Unsubscribe:
      https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
      

      ----
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
    
    -- 
Kenneth Murchison
Senior Software Developer
Fastmail US LLC
  

----
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus