Re: How to «bootstrap» xapian/squatter

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Le 26/09/2024 à 09:31:51+0200, Vladislav Kurz a écrit

Hi, 

> Dne 25. 09. 24 v 21:23 Albert Shih napsal(a):
> > Hi everyone.
> > 
> > So I would like to know what would be the most efficient method to
> > bootstrap squatter.
> > 
> > On my new server after sync almost all the mail I got, I try to «bootstrap»
> > squatter, meaning I launch the command squatter. But it's take lot of time.
> > So I try to run 64 threads (the server got 32 cores) of squatter, but still
> > after 10 h I just run 10% of the mailbox.
> > 
> > Is they are any way to speed up ? Or the only solution is to wait ?
> > 
> > Regards
> 
> I'd not run squatter on as many threads as possible. I expect I/O would be
> the bottleneck in this case.

Thanks for the tips, I though about it but I run with 16 nvme ssd, and the
server are still in test phase. 

With the right search_batchsize I think I will be able to index my 50
millions email in less than 4 hours. 

Regards.

-- 
Albert SHIH 🦫 🐸
Observatoire de Paris
France
Heure locale/Local time:
jeu. 26 sept. 2024 11:49:39 CEST

------------------------------------------
Cyrus: Info
Permalink: https://cyrus.topicbox.com/groups/info/Tb146f45ff23d5ffa-M0cf1a0967e055675b9a4173d
Delivery options: https://cyrus.topicbox.com/groups/info/subscription




[Index of Archives]     [Cyrus SASL]     [Squirrel Mail]     [Asterisk PBX]     [Video For Linux]     [Photo]     [Yosemite News]     [gtk]     [KDE]     [Gimp on Windows]     [Steve's Art]
  Powered by Linux