Hi Brian, I am looking into the issue. Mostly the issue is with rename() not create(). Let me get back with more information. Regards, Amar On Fri, May 30, 2008 at 8:51 AM, Brian Taber <btaber@xxxxxxxxxxxxx> wrote: > I am using glusterfs 1.3.9 (glusterfs--mainline--2.5--patch-770) I am > using Dovecot for email retrieval. Dovecot creates files called > dovecot-uidlist which is a listing of all messages int he mailbox. > somehow, the file is getting created on more than one brick, which > causes gluster to go nuts and deny access to the file. Here is the > errors in the client log: > > 2008-05-30 11:31:43 E [unify.c:873:unify_open] brick: > /domain.com/usermailbox/dovecot-uidlist: entry_count is 3 > 2008-05-30 11:31:43 E [unify.c:876:unify_open] brick: > /domain.com/usermailbox/dovecot-uidlist: found on mail > 2008-05-30 11:31:43 E [unify.c:876:unify_open] brick: > /domain.com/usermailbox/dovecot-uidlist: found on mail2 > 2008-05-30 11:31:43 E [unify.c:876:unify_open] brick: > /domain.com/usermailbox/dovecot-uidlist: found on ns-mail > 2008-05-30 11:31:43 E [fuse-bridge.c:692:fuse_fd_cbk] glusterfs-fuse: > 1530174: (12) /domain.com/usermailbox/dovecot-uidlist => -1 (5) > > On the server there is stranger errors: > 2008-05-29 11:57:27 E [posix.c:1984:posix_setdents] ns-mail: Error > creating file > /data2/gluster-index/mail/domain.com/usermailbox/dovecot-uidlist with > mode (0100600) > 2008-05-29 13:30:23 E [posix.c:1984:posix_setdents] ns-mail: Error > creating file > /data2/gluster-index/mail/domain.com/usermailbox/dovecot-uidlist with > mode (0100600) > 2008-05-29 13:30:23 E [posix.c:1984:posix_setdents] ns-mail: Error > creating file > /data2/gluster-index/mail/domain.com/usermailbox/courierpop3dsizelist > with mode (0100644) > 2008-05-29 13:30:23 E [posix.c:1984:posix_setdents] ns-mail: Error > creating file > /data2/gluster-index/mail/domain.com/usermailbox/maildirsize with mode > (0100644) > 2008-05-29 13:30:23 E [posix.c:1984:posix_setdents] ns-mail: Error > creating file > /data2/gluster-index/mail/domain.com/usermailbox/dovecot-keywords with > mode (0100600) > 2008-05-29 13:30:23 E [posix.c:1984:posix_setdents] ns-mail: Error > creating file > /data2/gluster-index/mail/domain.com/usermailbox/dovecot.index.cache > with mode (0100600) > > > > How can this file be created on more than one brick? > What are all these errors I cam getting on the server? The files the > server is yelling about exist. > Am I doing something wrong? > > > > My configs looks like this: > > # namespace > volume ns-mail > type protocol/client > option transport-type tcp/client > option remote-host 192.168.200.200 > option remote-port 7010 > option remote-subvolume ns-mail > end-volume > > # first storage vol > volume mail > type protocol/client > option transport-type tcp/client > option remote-host 192.168.200.200 > option remote-port 7011 > option remote-subvolume io-threads-mail > end-volume > > # second storage vol > volume mail2 > type protocol/client > option transport-type tcp/client > option remote-host 192.168.200.200 > option remote-port 7012 > option remote-subvolume io-threads-mail2 > end-volume > > volume brick > type cluster/unify > subvolumes mail mail2 > option namespace ns-mail > option scheduler alu > option alu.limits.min-free-disk 5% # Don't create files one a > volume with less than 5% free diskspace > option alu.limits.max-open-files 10000 # Don't create files on a > volume with more than 10000 files open > > option alu.order > disk-usage:read-usage:write-usage:open-files-usage:disk-speed-usage > option alu.disk-usage.entry-threshold 2GB # Kick in if the > discrepancy in disk-usage between volumes is more than 2GB > option alu.disk-usage.exit-threshold 60MB # Don't stop writing to > the least-used volume until the discrepancy is 1988MB > option alu.open-files-usage.entry-threshold 1024 # Kick in if the > discrepancy in open files is 1024 > option alu.open-files-usage.exit-threshold 32 # Don't stop until 992 > files have been written the least-used volume > option alu.stat-refresh.interval 10sec # Refresh the statistics used > for decision-making every 10 seconds > end-volume > > > my 3 server configs are: > 1: > volume ns-mail > type storage/posix > option directory /data2/gluster-index/mail > end-volume > > volume server > type protocol/server > subvolumes ns-mail > option transport-type tcp/server # For TCP/IP transport > option listen-port 7010 > option auth.ip.ns-mail.allow 192.168.* > end-volume > > > 2: > volume mail > type storage/posix > option directory /data/mail > end-volume > > volume posix-locks-mail > type features/posix-locks > option mandatory on > subvolumes mail > end-volume > > volume io-threads-mail > type performance/io-threads > option thread-count 8 > option cache-size 4096MB > subvolumes posix-locks-mail > end-volume > > volume server > type protocol/server > subvolumes posix-locks-mail > option transport-type tcp/server # For TCP/IP transport > option listen-port 7011 > option auth.ip.io-threads-mail.allow 192.168.* > option auth.ip.posix-locks-mail.allow 192.168.* > end-volume > > 3: > volume mail2 > type storage/posix > option directory /data3/mail > end-volume > > volume posix-locks-mail2 > type features/posix-locks > option mandatory on > subvolumes mail2 > end-volume > > volume io-threads-mail2 > type performance/io-threads > option thread-count 8 > option cache-size 4096MB > subvolumes posix-locks-mail2 > end-volume > > volume server > type protocol/server > subvolumes posix-locks-mail2 > option transport-type tcp/server # For TCP/IP transport > option listen-port 7012 > option auth.ip.io-threads-mail2.allow 192.168.* > option auth.ip.posix-locks-mail2.allow 192.168.* > end-volume > > > -- > > ------------------------- > Brian Taber > Owner/IT Specialist > Diverse Computer Group > Office: 774-206-5592 > Cell: 508-496-9221 > btaber@xxxxxxxxxxxxx > > > > _______________________________________________ > Gluster-devel mailing list > Gluster-devel@xxxxxxxxxx > http://lists.nongnu.org/mailman/listinfo/gluster-devel > > -- Amar Tumballi Gluster/GlusterFS Hacker [bulde on #gluster/irc.gnu.org] http://www.zresearch.com - Commoditizing Super Storage!
