Tried looking into the source of squatter and verbosing on a specific folder that always shows the problem.
Here is how it ends:
Processing index character 128, 9 total words, temp file size is 41
Processing index character 130, 8 total words, temp file size is 52
Processing index character 147, 2 total words, temp file size is 12
Processing index character 152, 2 total words, temp file size is 12
Processing index character 153, 5 total words, temp file size is 26
Processing index character 172, 10 total words, temp file size is 66
Processing index character 176, 72 total words, temp file size is 498
Processing index character 191, 417128205 total words, temp file size is 1251444163
Closing index: Not enough space
Processing index character 130, 8 total words, temp file size is 52
Processing index character 147, 2 total words, temp file size is 12
Processing index character 152, 2 total words, temp file size is 12
Processing index character 153, 5 total words, temp file size is 26
Processing index character 172, 10 total words, temp file size is 66
Processing index character 176, 72 total words, temp file size is 498
Processing index character 191, 417128205 total words, temp file size is 1251444163
Closing index: Not enough space
I will look and change the source to give more info on the backtrace of the error, but maybe someone here alreay has any idea?
Gabriele
Da: Gabriele Bulfon <gbulfon@xxxxxxxxxxx>
A: Vladislav Kurz <vladislav.kurz@xxxxxxxxxxx>Mark <cyrus@xxxxxxxxxxx>info-cyrus <info-cyrus@xxxxxxxxxxxxxxxxxxxx>
Data: 17 dicembre 2019 7.26.35 CET
Oggetto: Re: Squatter segfault on big mailbox
Da: Gabriele Bulfon <gbulfon@xxxxxxxxxxx>
A: Vladislav Kurz <vladislav.kurz@xxxxxxxxxxx>Mark <cyrus@xxxxxxxxxxx>info-cyrus <info-cyrus@xxxxxxxxxxxxxxxxxxxx>
Data: 17 dicembre 2019 7.26.35 CET
Oggetto: Re: Squatter segfault on big mailbox
Hello, we're having the same problem with Cyrus 2.5.11 on XStreamOS/illumosAny idea how to fix this?Same problem both on 32 bit large files build, and 64 bit.Looks like the Debian issue has no solution.Can't believe this has never been addressed.Gabriele
----------------------------------------------------------------------------------
Da: Vladislav Kurz <vladislav.kurz@xxxxxxxxxxx>
A: Mark <cyrus@xxxxxxxxxxx> info-cyrus <info-cyrus@xxxxxxxxxxxxxxxxxxxx>
Data: 11 ottobre 2017 9.37.21 CEST
Oggetto: Re: Squatter segfault on big mailbox
On 10/11/17 07:37, Mark wrote:
> On 2017-10-10 16:05, Vladislav Kurz wrote:
>> Hello everyone,
>>
>> we have recently migrated our mail server from cyrus 2.2 to 2.5 (both
>> debian packages).
>>
>> We have a problem that squatter segfaults on some quite big mailboxes.
>> I had to add -i (--incremental) to at least index new mails. But users
>> cannot search in old mails (before migration). I used strace to find out
>> if it is some particular mail, but it parsed everything fine, and failed
>> when dealing with some of the many temporary files squatXXXX.
>>
>> The problematic mailboxes have just inbox > 10 GB (and >15 GB with all
>> subfolders) and >20000 emails in inbox.
>>
>> Has anyone else hit similar problem and solved it somehow?
>
> I'm not sure about fixes, but there are some reports of similar
> problems. Have a look at the thread with the subject "Cyrus 2.5.10 IMAP
> search" from the beginning of June this year.
>
> Apparently the format of the squatter database changed between 2.4 and
> 2.5, and some people (at least) have seen a 10x increase in the size of
> the squatter database for the same mailbox. For systems that only allow
> 2GB mmap, this can be a problem.
>
> I'm not sure if this increase in size is a bug or a feature.
>
> Mark
>
Hello Mark,
Thanks for the hint about old discussion. Unfortunately, there was no
solution to this issue mentioned. I found out that this was already
reported to debian, I wonder whetrher the maintainer forwarded the bug
report upstream.
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=871921
This is on 64-bit Linux, so mmap should not be limited to 2 GB.
And I also have noticed the extreme increase in squat file sizes.
--
Best Regards
Vladislav Kurz
----
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus---- Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
---- Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
