Re: How to «bootstrap» xapian/squatter

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



El 26/9/24 a les 13:05, Luca Olivetti via Info ha escrit:


I "only" have around 600000 messages.

Anyway, ctl_conversationsdb also segfaulted for another user with just a handful of messages (around 7k, 650MB) when the conversations db, again, reached the 4.1GB size.

These are my search parameters in imapd.conf

search_engine: xapian
search_index_headers: no
search_batchsize: 1000000
defaultsearchtier: t1
t1searchpartition-default: /var/spool/cyrus/search
conversations: 1
sync_log: on
sync_log_channels: squatter
search_fuzzy_always: 1


I though that maybe the segfault was due to a memory error, but the virtual machine (actually an lxc container in proxmox) has 8GB assigned and the usage stays well below 2GB.


I ran ctl_conversationsdb under gdb but I'm none the wiser



(gdb) run -b martina
Starting program: /usr/lib/cyrus/bin/ctl_conversationsdb -b martina
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".

Program received signal SIGSEGV, Segmentation fault.
find_node (db=db@entry=0x55555558b2f0, key=key@entry=0x55555594d5f0 "<811888067.380385.1718626958015@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx>", keylen=keylen@entry=64, updateoffsets=updateoffsets@entry=0x0)
    at lib/cyrusdb_skiplist.c:1026
1026    lib/cyrusdb_skiplist.c: Permission denied.
(gdb) bt
#0 find_node (db=db@entry=0x55555558b2f0, key=key@entry=0x55555594d5f0 "<811888067.380385.1718626958015@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx>", keylen=keylen@entry=64, updateoffsets=updateoffsets@entry=0x0)
    at lib/cyrusdb_skiplist.c:1026
#1 0x00007ffff7d865c4 in myfetch (db=0x55555558b2f0, key=0x55555594d5f0 "<811888067.380385.1718626958015@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx>", keylen=64, data=0x7fffffffdfa0, datalen=0x7fffffffdf98, tidptr=<optimized out>)
    at lib/cyrusdb_skiplist.c:1074
#2 0x00007ffff7eb761e in conversations_get_msgid (state=state@entry=0x55555558dbc0, msgid=msgid@entry=0x55555594d5f0 "<811888067.380385.1718626958015@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx>", cids=cids@entry=0x7fffffffe070)
    at imap/conversations.c:783
#3 0x00007ffff7f100f3 in extract_convdata (state=state@entry=0x55555558dbc0, msg=<optimized out>, msgidlist=msgidlist@entry=0x7fffffffe200, matchlist=matchlist@entry=0x7fffffffe210, msubjp=msubjp@entry=0x7fffffffe1e0)
    at imap/message.c:3819
#4 0x00007ffff7f1064c in message_update_conversations (state=state@entry=0x55555558dbc0, mailbox=0x5555556708c0, record=record@entry=0x7fffffffe330, convp=convp@entry=0x0) at imap/message.c:3878 #5 0x0000555555556992 in build_cid_cb (mbentry=0x55555558b210, rock=<optimized out>) at imap/ctl_conversationsdb.c:231 #6 0x00007ffff7d7eecd in cyrusdb_forone (db=<optimized out>, key=0x55555558dfa0 "Nuser\037martina\177", keylen=keylen@entry=13, p=p@entry=0x7ffff7eee120 <allmbox_p>, cb=cb@entry=0x7ffff7eee020 <allmbox_cb>,
    rock=rock@entry=0x7fffffffe540, tid=0x0) at lib/cyrusdb.c:301
#7 0x00007ffff7ef3fa0 in mboxlist_mboxtree (mboxname=mboxname@entry=0x555555571d20 "user.martina", proc=proc@entry=0x5555555568d0 <build_cid_cb>, rock=rock@entry=0x0, flags=flags@entry=0) at imap/mboxlist.c:3715 #8 0x00007ffff7ef4270 in mboxlist_usermboxtree (userid=userid@entry=0x7fffffffee0c "martina", auth_state=auth_state@entry=0x0, proc=0x5555555568d0 <build_cid_cb>, rock=0x0, flags=0) at imap/mboxlist.c:3942 #9 0x00005555555576b7 in do_build (userid=<optimized out>) at imap/ctl_conversationsdb.c:259 #10 do_user (userid=userid@entry=0x7fffffffee0c "martina", rock=rock@entry=0x0) at imap/ctl_conversationsdb.c:794 #11 0x00005555555566a5 in main (argc=<optimized out>, argv=<optimized out>) at imap/ctl_conversationsdb.c:930
(gdb)


Bye
--
Luca Olivetti
Wetron Automation Technology https://wetron.es/
Tel. +34 93 5883004 (Ext.3010)  Fax +34 93 5883007


------------------------------------------
Cyrus: Info
Permalink: https://cyrus.topicbox.com/groups/info/Tb146f45ff23d5ffa-M6d2a12101ea032a04d51c7f2
Delivery options: https://cyrus.topicbox.com/groups/info/subscription




[Index of Archives]     [Cyrus SASL]     [Squirrel Mail]     [Asterisk PBX]     [Video For Linux]     [Photo]     [Yosemite News]     [gtk]     [KDE]     [Gimp on Windows]     [Steve's Art]
  Powered by Linux