Re: How to «bootstrap» xapian/squatter

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 2024-09-27 8:21 AM, Luca Olivetti via Info wrote:
El 26/9/24 a les 22:46, Luca Olivetti via Info ha escrit:
El 26/9/24 a les 21:50, Luca Olivetti via Info ha escrit:
El 26/9/24 a les 20:34, Luca Olivetti via Info ha escrit:
El 26/9/24 a les 19:52, Luca Olivetti via Info ha escrit:
El 26/9/24 a les 19:43, Nels Lindquist ha escrit:

OK, I'll try twoskip an report back


Mmh, with twoskip the conversations db is already 8.3GB, I don't think this is going to end well....

I installed cyrus 3.8.1 from backports, reverted the setting for conversations_db to skiplist, and ctl_conversationsdb still segfaults when the file grows to 4.1GB :-(


I'm now trying the squat backend (removing the need for the conversations db) and both the indexing and the search work.
Pity that it's being phased out.

search_engine: squat
search_index_headers: no
search_batchsize: 1000000
defaultsearchtier: t1
t1searchpartition-default: /var/spool/cyrus/search
conversations: 0
sync_log: off
sync_log_channels: squatter
search_fuzzy_always: 1
conversations_db: skiplist


(I know that some parameters make no sense with squat an no conversations but I left them there in case I want to try xapian again later)


For the record, I solved the problem by following the instructions in

https://www.cyrusimap.org/imap/download/upgrade.html

specifically using the

reconstruct -G -V

command then nuking (ctl_conversationsdb -z) and rebuilding (ctl_conversationsdb -b) the conversations db for each user, then I used "squatter -v" to reindex all the messages.

I guess that ctl_conversationsdb in the two versions I tried (3.6.1 and 3.8.1) has no safeguards against malformed mailboxes.

(BTW, the above is using 3.6.1, I removed the 3.8.1 version from backports).

This is fine and dandy for this small test server with 4 users, I'll have to devise a better way to migrate the production server.

Yeah, looks like the squatter fixes applied to later 3.6.x versions were applied simultaneously in the 3.8.x branch, so 3.8.1 probably has the same issues as 3.6.1.

Glad you got it figured out!


--
Nels Lindquist
nlindq@xxxxxxx


------------------------------------------
Cyrus: Info
Permalink: https://cyrus.topicbox.com/groups/info/Tb146f45ff23d5ffa-Mbca029f46f41955b3d855acd
Delivery options: https://cyrus.topicbox.com/groups/info/subscription




[Index of Archives]     [Cyrus SASL]     [Squirrel Mail]     [Asterisk PBX]     [Video For Linux]     [Photo]     [Yosemite News]     [gtk]     [KDE]     [Gimp on Windows]     [Steve's Art]
  Powered by Linux