Re: Search Folder size - Xapian enabled

["Robert Stepanek" <rsto@xxxxxxxxxxxxxxxx>]

On Tue, Mar 22, 2022, at 9:36 PM, Infraestructura TIC - UNNOBA wrote:

Robert, this command do the magic:

#sudo -u cyrus /usr/lib/cyrus/bin/squatter -t t1 -z t1

#du -hs /var/spool/cyrus/search/
784M    .

Great!

Now, would you recommend to put it in cyrus.conf, like

        squatterz      cmd="/usr/sbin/cyrus squatter -t t1 -z t1" at 0400

or execute it via crontab?

Either should work equally fine.

Cheers,

Robert

Thanks!

Javier.-

El 22/3/22 a las 12:05, Tecnologia UNNOBA escribió:

Hi, Robert!

Thanks for your quick response!

This server has only 2 accounts: javier y tecno.

Total of mail storage is

mailserver:/var/spool/cyrus/mail# du -hs
996M    .

And xapian search directories are:

mailserver:/var/spool/cyrus/search/t/user/tecno/xapian.1# ls -all -h
total 34G
drwx------ 2 cyrus mail 4,0K mar 22 11:58 .
drwx------ 3 cyrus mail 4,0K ene 25 09:20 ..
-rw------- 1 cyrus mail 1,9K mar 22 11:53 cyrus.indexed.db
-rw------- 1 cyrus mail    0 mar 22 11:57 flintlock
-rw------- 1 cyrus mail  150 mar 22 11:53 iamglass
-rw------- 1 cyrus mail  20G mar 22 11:58 position.glass
-rw------- 1 cyrus mail 6,8G mar 22 11:58 postlist.glass
-rw------- 1 cyrus mail 7,2G mar 22 11:58 termlist.glass
-rw------- 1 cyrus mail  151 mar 22 11:58 v.tmp

mailserver:/var/spool/cyrus/search/j/user/javier/xapian.1# ls -all -h
total 21G
drwx------ 2 cyrus mail 4,0K mar 22 11:57 .
drwx------ 3 cyrus mail 4,0K ene 25 09:12 ..
-rw------- 1 cyrus mail 6,6K mar 22 11:57 cyrus.indexed.db
-rw------- 1 cyrus mail    0 mar 22 11:56 flintlock
-rw------- 1 cyrus mail  149 mar 22 11:56 iamglass
-rw------- 1 cyrus mail  12G mar 22 11:56 position.glass
-rw------- 1 cyrus mail 4,2G mar 22 11:56 postlist.glass
-rw------- 1 cyrus mail 4,4G mar 22 11:56 termlist.glass

I can't find "xapian-version" that you mention.

Instead:

server1:/var/spool/cyrus/mail# xapian-check --version
xapian-check - xapian-core 1.4.18

I didn't compacted those databases. I founded some perl scripts on internet that execute via crontab, but I didn't know if cyrus can/must do it himself.

Thanks again.

El 22/3/22 a las 10:12, Robert Stepanek escribió:

Hi,

On Tue, Mar 22, 2022, at 1:30 PM, Infraestructura TIC - UNNOBA wrote:

mailserver:/# du -hs /var/spool/cyrus/mail/

1,1G    /var/spool/cyrus/mail/

mailserver:/# du -hs /var/spool/cyrus/search

53G    /var/spool/cyrus/search

This indeed looks odd. Could please identify which files contribute the most to the 53G? If so far you haven't compacted your search tiers, it should be enough to just do something like:

# ls -l <your search partitionndirectory>/user/uuid/6/c/6c0d5168-1c8d-4ff8-8cd8-f6682fd4fb65/xapian/
total 64
-rw------- 1 cyrus mail   504 Mar 22 12:13 cyrus.indexed.db
-rw------- 1 cyrus mail     0 Mar 22 12:13 flintlock
-rw------- 1 cyrus mail    95 Mar 22 12:13 iamglass
-rw------- 1 cyrus mail  8192 Mar 22 12:13 position.glass
-rw------- 1 cyrus mail 24576 Mar 22 12:13 postlist.glass
-rw------- 1 cyrus mail 24576 Mar 22 12:13 termlist.glass

Also, what Xapian version do you use? Calling xapian-version --version will tell.

Cheers,

Robert

Cyrus / Info / see discussions + participants + delivery options Permalink