On Tue, 2009-09-08 at 16:56 +0200, Michael Menge wrote: [...] > Quoting Bernd Petrovitsch <bernd@xxxxxxxxx>: [...] > > We are running cyrus-imapd with all files (mailboxes, Berkeley-DB, > > mmap()ed files) on an ext3 filesystem (with data=ordered) on a iSCSI > > block device (and the actual storage is on a NetApp box if that matters) > > on a Xeon 3.2GHz CPU (with 4 cores/2 HT thread - ). > > The kernel is 2.6.18-128.el5 (from the RHEL5/CentOS-5 updates). > > Don't know if i can help as we have an different setting > cyrus-2.3.14, SLES 10, xfs on iSCSI and Skiplist instead of BDB. How large is the setup? We have ~25K mailboxes with ~1E6 mails per day (on the average) and run up to 300 popds and some imapds in parallel. > > On a low-(to-now-)volume test cluster, everything runs fine. On the > > high-volume production cluster[0], we experienced a corrupted BDB. > > Googling didn't yield any useful result on the cause (or hint on > > improvement of the configuration). > > > Which Version of Cyrus did you use? Which DB was Corrupted? - cyrus-imapd-2.3.7 (from RHEL5/CentOS-5) with some minor patches in the popd (UUID format and an enhancement to the authentication - both shouldn't have any impact on the storage part) - The duplicate.db. Yes, we (can and will) scrap it (if only to fix the current problem) - and we don't use duplicate suppression anyways (because of the performance impact). > Did this happen only once or on a regulare base? It happened now and then and is somewhat inconvenient. And it's not fun if the /var/log partition is full just because cyr_expire stumbles over a corrupted BDB. > > Does anyone have experience with such a setup? > > With the differences mentioned above, this setups works fine. We switched to iSCSI just recently - so that's the only really "new" thing in the setup. And it works fine hereover too (and since the popds, imapds and mail delivery work just fine, it's not a crisis now) - it's just the annoyance as above every other month or so. Bernd -- Firmix Software GmbH http://www.firmix.at/ mobil: +43 664 4416156 fax: +43 1 7890849-55 Embedded Linux Development and Services ---- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html