Hi, Can you send the glusterfs server logs? The logs you've sent are of booster (which is glusterfs client). Looking at the configuration, there is a protocol/client in configuration and hence you need a glusterfs server running. We'll work on issue of md5sums being different. regards, On Tue, Jan 12, 2010 at 2:20 AM, Liam Slusser <lslusser at gmail.com> wrote: > Logs are below. I also noticed this while trying to debug this > issue...Notice the md5sum do not match up below? > > On the fuse mounted system: > > [root at server test]# ls -al test.mp3 > -rw-r--r-- 1 user group 3692251 Aug 27 2007 test.mp3 > > [root at server test]# md5sum test.mp3 > d480d794882c814ae1a2426b79cf8b3e test.mp3 > > Using glusterfs-boost.so: > > [root at server tmp]# > > LD_PRELOAD="/home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/glusterfs-booster.so" > ls -al /pub/data/tnsc/test/test.mp3 > ls: /pub/data/tnsc/test/test.mp3: Invalid argument > -rw-r--r-- 1 tcode tcode 3692251 Aug 27 2007 /pub/data/tnsc/test/test.mp3 > > [root at server tmp]# > > LD_PRELOAD="/home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/glusterfs-booster.so" > cp /pub/data/tnsc/test/test.mp3 /tmp/test.mp3 > > [root at server tmp]# md5sum /tmp/test.mp3 > 9bff3bb90b6897fc19b6b4658b83f3f8 /tmp/test.mp3 > > [root at server tmp]# ls -al /tmp/test.mp3 > -rw-r--r-- 1 root root 3690496 Jan 11 14:10 /tmp/test.mp3 > > Here are the gluster logs from a clean apache start and one request to > test.mp3 with wget: > > [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator: > dlsym(notify) on > > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-threads.so: > undefined symbol: notify -- neglecting > [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator: > dlsym(notify) on > > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/read-ahead.so: > undefined symbol: notify -- neglecting > [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator: > dlsym(notify) on > > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-cache.so: > undefined symbol: notify -- neglecting > [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick1a: > defaulting frame-timeout to 30mins > [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick1a: > defaulting ping-timeout to 10 > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick2a: > defaulting frame-timeout to 30mins > [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick2a: > defaulting ping-timeout to 10 > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [io-threads.c:2280:init] iothreads: > io-threads: Autoscaling: off, min_threads: 32, max_threads: 32 > [2010-01-11 14:16:02] D [read-ahead.c:824:init] readahead: Using > conf->page_count = 16 > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick1a: Connected to 192.168.12.30:6996, attached to remote volume > 'brick1a'. > [2010-01-11 14:16:02] N [afr.c:2194:notify] replicate: Subvolume > 'brick1a' came back up; going online. > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick1a: Connected to 192.168.12.30:6996, attached to remote volume > 'brick1a'. > [2010-01-11 14:16:02] N [afr.c:2194:notify] replicate: Subvolume > 'brick1a' came back up; going online. > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick2a: Connected to 192.168.12.35:6996, attached to remote volume > 'brick2a'. > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick2a: Connected to 192.168.12.35:6996, attached to remote volume > 'brick2a'. > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1713:libgf_vmp_map_ghandle] libglusterfsclient: > New Entry: /pub > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1421:libgf_init_vmpentry] libglusterfsclient: > New VMP entry: /pub > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1724:libgf_vmp_map_ghandle] libglusterfsclient: > Empty list > [2010-01-11 14:16:02] D [booster.c:1190:booster_init] booster: booster is > inited > [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat] > libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/conf/httpd.conf > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/apps/httpd-2.2.14/conf/httpd.conf, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: > /home/httpd/apps/httpd-2.2.14/conf/httpd.conf > [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open] > libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/conf/httpd.conf > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/apps/httpd-2.2.14/conf/httpd.conf, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: > /home/httpd/apps/httpd-2.2.14/conf/httpd.conf > [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed > [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using > MPB: /home/httpd/apps/httpd-2.2.14/conf/httpd.conf > [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr > user.glusterfs-booster-volfile not found: No data available > [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat] > libglusterfsclient: path /home/httpd/apps/httpd-2.2.14 > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path /home/httpd/apps/httpd-2.2.14, > type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: /home/httpd/apps/httpd-2.2.14 > [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat] > libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/bin/suexec > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/apps/httpd-2.2.14/bin/suexec, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: /home/httpd/apps/httpd-2.2.14/bin/suexec > [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat] > libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/htdocs > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/apps/httpd-2.2.14/htdocs, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: /home/httpd/apps/httpd-2.2.14/htdocs > [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open] > libglusterfsclient: path /home/httpd/logs/www/llfeed-error_log.new > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/logs/www/llfeed-error_log.new, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: /home/httpd/logs/www/llfeed-error_log.new > [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed > [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using > MPB: /home/httpd/logs/www/llfeed-error_log.new > [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr > user.glusterfs-booster-volfile not found: No data available > [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open] > libglusterfsclient: path /home/httpd/logs/www/llfeed-access_log.new > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/logs/www/llfeed-access_log.new, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: /home/httpd/logs/www/llfeed-access_log.new > [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed > [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using > MPB: /home/httpd/logs/www/llfeed-access_log.new > [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr > user.glusterfs-booster-volfile not found: No data available > [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open] > libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/conf/mime.types > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/apps/httpd-2.2.14/conf/mime.types, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: > /home/httpd/apps/httpd-2.2.14/conf/mime.types > [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed > [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using > MPB: /home/httpd/apps/httpd-2.2.14/conf/mime.types > [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr > user.glusterfs-booster-volfile not found: No data available > [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat] > libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/conf/httpd.conf > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/apps/httpd-2.2.14/conf/httpd.conf, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: > /home/httpd/apps/httpd-2.2.14/conf/httpd.conf > [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open] > libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/conf/httpd.conf > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/apps/httpd-2.2.14/conf/httpd.conf, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: > /home/httpd/apps/httpd-2.2.14/conf/httpd.conf > [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed > [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using > MPB: /home/httpd/apps/httpd-2.2.14/conf/httpd.conf > [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr > user.glusterfs-booster-volfile not found: No data available > [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat] > libglusterfsclient: path /home/httpd/apps/httpd-2.2.14 > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path /home/httpd/apps/httpd-2.2.14, > type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: /home/httpd/apps/httpd-2.2.14 > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path /pub/, type: Exact > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick1a: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick2a: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] replicate: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] iothreads: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] readahead: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] cache: fini done > [2010-01-11 14:16:02] D [dict.c:366:dict_destroy] dict: @this=(nil) > [2010-01-11 14:16:02] D [booster_fstab.c:46:glusterfs_fstab_init] > booster-fstab: FSTAB file: /etc/booster.fstab > [2010-01-11 14:16:02] D [booster_fstab.c:385:booster_mount] > booster-fstab: Mount entry: volfile: > > /home/gluster/apps/glusterfs-2.0.9/etc/glusterfs/glusterfs.vol-pubstore.booster, > VMP: /pub/, Type: glusterfs, Options: > > subvolume=cache,logfile=/home/gluster/apps/glusterfs-2.0.9/var/log/glusterfs/booster-pubstore.log,loglevel=DEBUG,attr_timeout=0 > [2010-01-11 14:16:02] D > [libglusterfsclient.c:869:libgf_resolve_path_light] > libglusterfsclient: Path: /pub/, Resolved Path: /pub > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path /pub/, type: Exact > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1544:_libgf_vmp_search_entry] > libglusterfsclient: Virtual Mount Point list is empty. > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1603:libgf_vmp_search_exact_entry] > libglusterfsclient: VMP Entry not found: path: /pub/ > [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator: > dlsym(notify) on > > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-threads.so: > undefined symbol: notify -- neglecting > [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator: > dlsym(notify) on > > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/read-ahead.so: > undefined symbol: notify -- neglecting > [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator: > dlsym(notify) on > > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-cache.so: > undefined symbol: notify -- neglecting > [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick1a: > defaulting frame-timeout to 30mins > [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick1a: > defaulting ping-timeout to 10 > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick2a: > defaulting frame-timeout to 30mins > [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick2a: > defaulting ping-timeout to 10 > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [io-threads.c:2280:init] iothreads: > io-threads: Autoscaling: off, min_threads: 32, max_threads: 32 > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path /pub/, type: Exact > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick1a: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick2a: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] replicate: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] iothreads: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] readahead: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] cache: fini done > [2010-01-11 14:16:02] D [dict.c:366:dict_destroy] dict: @this=(nil) > [2010-01-11 14:16:02] D [read-ahead.c:824:init] readahead: Using > conf->page_count = 16 > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick1a: Connected to 192.168.12.30:6996, attached to remote volume > 'brick1a'. > [2010-01-11 14:16:02] N [afr.c:2194:notify] replicate: Subvolume > 'brick1a' came back up; going online. > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick1a: Connected to 192.168.12.30:6996, attached to remote volume > 'brick1a'. > [2010-01-11 14:16:02] N [afr.c:2194:notify] replicate: Subvolume > 'brick1a' came back up; going online. > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick2a: Connected to 192.168.12.35:6996, attached to remote volume > 'brick2a'. > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick2a: Connected to 192.168.12.35:6996, attached to remote volume > 'brick2a'. > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1713:libgf_vmp_map_ghandle] libglusterfsclient: > New Entry: /pub > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1421:libgf_init_vmpentry] libglusterfsclient: > New VMP entry: /pub > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1724:libgf_vmp_map_ghandle] libglusterfsclient: > Empty list > [2010-01-11 14:16:02] D [booster.c:1190:booster_init] booster: booster is > inited > [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat] > libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/bin/suexec > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/apps/httpd-2.2.14/bin/suexec, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: /home/httpd/apps/httpd-2.2.14/bin/suexec > [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat] > libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/htdocs > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/apps/httpd-2.2.14/htdocs, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: /home/httpd/apps/httpd-2.2.14/htdocs > [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open] > libglusterfsclient: path /home/httpd/logs/www/llfeed-error_log.new > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/logs/www/llfeed-error_log.new, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: /home/httpd/logs/www/llfeed-error_log.new > [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed > [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using > MPB: /home/httpd/logs/www/llfeed-error_log.new > [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr > user.glusterfs-booster-volfile not found: No data available > [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open] > libglusterfsclient: path /home/httpd/logs/www/llfeed-access_log.new > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/logs/www/llfeed-access_log.new, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: /home/httpd/logs/www/llfeed-access_log.new > [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed > [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using > MPB: /home/httpd/logs/www/llfeed-access_log.new > [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr > user.glusterfs-booster-volfile not found: No data available > [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open] > libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/conf/mime.types > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/apps/httpd-2.2.14/conf/mime.types, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: > /home/httpd/apps/httpd-2.2.14/conf/mime.types > [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed > [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using > MPB: /home/httpd/apps/httpd-2.2.14/conf/mime.types > [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr > user.glusterfs-booster-volfile not found: No data available > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path /pub/, type: Exact > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick1a: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick2a: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] replicate: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] iothreads: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] readahead: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] cache: fini done > [2010-01-11 14:16:02] D [dict.c:366:dict_destroy] dict: @this=(nil) > [2010-01-11 14:16:02] D [booster_fstab.c:46:glusterfs_fstab_init] > booster-fstab: FSTAB file: /etc/booster.fstab > [2010-01-11 14:16:02] D [booster_fstab.c:385:booster_mount] > booster-fstab: Mount entry: volfile: > > /home/gluster/apps/glusterfs-2.0.9/etc/glusterfs/glusterfs.vol-pubstore.booster, > VMP: /pub/, Type: glusterfs, Options: > > subvolume=cache,logfile=/home/gluster/apps/glusterfs-2.0.9/var/log/glusterfs/booster-pubstore.log,loglevel=DEBUG,attr_timeout=0 > [2010-01-11 14:16:02] D > [libglusterfsclient.c:869:libgf_resolve_path_light] > libglusterfsclient: Path: /pub/, Resolved Path: /pub > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path /pub/, type: Exact > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1544:_libgf_vmp_search_entry] > libglusterfsclient: Virtual Mount Point list is empty. > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1603:libgf_vmp_search_exact_entry] > libglusterfsclient: VMP Entry not found: path: /pub/ > [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator: > dlsym(notify) on > > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-threads.so: > undefined symbol: notify -- neglecting > [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator: > dlsym(notify) on > > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/read-ahead.so: > undefined symbol: notify -- neglecting > [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator: > dlsym(notify) on > > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-cache.so: > undefined symbol: notify -- neglecting > [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick1a: > defaulting frame-timeout to 30mins > [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick1a: > defaulting ping-timeout to 10 > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick2a: > defaulting frame-timeout to 30mins > [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick2a: > defaulting ping-timeout to 10 > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [io-threads.c:2280:init] iothreads: > io-threads: Autoscaling: off, min_threads: 32, max_threads: 32 > [2010-01-11 14:16:02] D [libglusterfsclient.c:4866:glusterfs_stat] > libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/logs/httpd.pid > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/apps/httpd-2.2.14/logs/httpd.pid, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: > /home/httpd/apps/httpd-2.2.14/logs/httpd.pid > [2010-01-11 14:16:02] D [libglusterfsclient.c:3001:glusterfs_open] > libglusterfsclient: path /home/httpd/apps/httpd-2.2.14/logs/httpd.pid > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/apps/httpd-2.2.14/logs/httpd.pid, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: > /home/httpd/apps/httpd-2.2.14/logs/httpd.pid > [2010-01-11 14:16:02] E [booster.c:398:vmp_open] booster: VMP open failed > [2010-01-11 14:16:02] D [booster.c:251:do_open] booster: Opening using > MPB: /home/httpd/apps/httpd-2.2.14/logs/httpd.pid > [2010-01-11 14:16:02] E [booster.c:256:do_open] booster: Xattr > user.glusterfs-booster-volfile not found: No data available > [2010-01-11 14:16:02] D [read-ahead.c:824:init] readahead: Using > conf->page_count = 16 > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path /pub/, type: Exact > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick1a: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick2a: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] replicate: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] iothreads: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] readahead: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] cache: fini done > [2010-01-11 14:16:02] D [dict.c:366:dict_destroy] dict: @this=(nil) > [2010-01-11 14:16:02] D [booster_fstab.c:46:glusterfs_fstab_init] > booster-fstab: FSTAB file: /etc/booster.fstab > [2010-01-11 14:16:02] D [booster_fstab.c:385:booster_mount] > booster-fstab: Mount entry: volfile: > > /home/gluster/apps/glusterfs-2.0.9/etc/glusterfs/glusterfs.vol-pubstore.booster, > VMP: /pub/, Type: glusterfs, Options: > > subvolume=cache,logfile=/home/gluster/apps/glusterfs-2.0.9/var/log/glusterfs/booster-pubstore.log,loglevel=DEBUG,attr_timeout=0 > [2010-01-11 14:16:02] D > [libglusterfsclient.c:869:libgf_resolve_path_light] > libglusterfsclient: Path: /pub/, Resolved Path: /pub > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path /pub/, type: Exact > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1544:_libgf_vmp_search_entry] > libglusterfsclient: Virtual Mount Point list is empty. > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1603:libgf_vmp_search_exact_entry] > libglusterfsclient: VMP Entry not found: path: /pub/ > [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator: > dlsym(notify) on > > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-threads.so: > undefined symbol: notify -- neglecting > [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator: > dlsym(notify) on > > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/read-ahead.so: > undefined symbol: notify -- neglecting > [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator: > dlsym(notify) on > > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-cache.so: > undefined symbol: notify -- neglecting > [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick1a: > defaulting frame-timeout to 30mins > [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick1a: > defaulting ping-timeout to 10 > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick2a: > defaulting frame-timeout to 30mins > [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick2a: > defaulting ping-timeout to 10 > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [io-threads.c:2280:init] iothreads: > io-threads: Autoscaling: off, min_threads: 32, max_threads: 32 > [2010-01-11 14:16:02] D [read-ahead.c:824:init] readahead: Using > conf->page_count = 16 > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path /pub/, type: Exact > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick1a: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] brick2a: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] replicate: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] iothreads: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] readahead: fini done > [2010-01-11 14:16:02] D [xlator.c:795:xlator_fini_rec] cache: fini done > [2010-01-11 14:16:02] D [dict.c:366:dict_destroy] dict: @this=(nil) > [2010-01-11 14:16:02] D [booster_fstab.c:46:glusterfs_fstab_init] > booster-fstab: FSTAB file: /etc/booster.fstab > [2010-01-11 14:16:02] D [booster_fstab.c:385:booster_mount] > booster-fstab: Mount entry: volfile: > > /home/gluster/apps/glusterfs-2.0.9/etc/glusterfs/glusterfs.vol-pubstore.booster, > VMP: /pub/, Type: glusterfs, Options: > > subvolume=cache,logfile=/home/gluster/apps/glusterfs-2.0.9/var/log/glusterfs/booster-pubstore.log,loglevel=DEBUG,attr_timeout=0 > [2010-01-11 14:16:02] D > [libglusterfsclient.c:869:libgf_resolve_path_light] > libglusterfsclient: Path: /pub/, Resolved Path: /pub > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path /pub/, type: Exact > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1544:_libgf_vmp_search_entry] > libglusterfsclient: Virtual Mount Point list is empty. > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1603:libgf_vmp_search_exact_entry] > libglusterfsclient: VMP Entry not found: path: /pub/ > [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator: > dlsym(notify) on > > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-threads.so: > undefined symbol: notify -- neglecting > [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator: > dlsym(notify) on > > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/read-ahead.so: > undefined symbol: notify -- neglecting > [2010-01-11 14:16:02] D [xlator.c:634:xlator_set_type] xlator: > dlsym(notify) on > > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/xlator/performance/io-cache.so: > undefined symbol: notify -- neglecting > [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick1a: > defaulting frame-timeout to 30mins > [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick1a: > defaulting ping-timeout to 10 > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [client-protocol.c:6130:init] brick2a: > defaulting frame-timeout to 30mins > [2010-01-11 14:16:02] D [client-protocol.c:6141:init] brick2a: > defaulting ping-timeout to 10 > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [transport.c:141:transport_load] transport: > attempt to load file > /home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/2.0.9/transport/socket.so > [2010-01-11 14:16:02] D [io-threads.c:2280:init] iothreads: > io-threads: Autoscaling: off, min_threads: 32, max_threads: 32 > [2010-01-11 14:16:02] D [read-ahead.c:824:init] readahead: Using > conf->page_count = 16 > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick2a: Connected to 192.168.12.35:6996, attached to remote volume > 'brick2a'. > [2010-01-11 14:16:02] N [afr.c:2194:notify] replicate: Subvolume > 'brick2a' came back up; going online. > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick2a: Connected to 192.168.12.35:6996, attached to remote volume > 'brick2a'. > [2010-01-11 14:16:02] N [afr.c:2194:notify] replicate: Subvolume > 'brick2a' came back up; going online. > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick1a: Connected to 192.168.12.30:6996, attached to remote volume > 'brick1a'. > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick1a: Connected to 192.168.12.30:6996, attached to remote volume > 'brick1a'. > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick2a: Connected to 192.168.12.35:6996, attached to remote volume > 'brick2a'. > [2010-01-11 14:16:02] N [afr.c:2194:notify] replicate: Subvolume > 'brick2a' came back up; going online. > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick1a: Connected to 192.168.12.30:6996, attached to remote volume > 'brick1a'. > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick1a: Connected to 192.168.12.30:6996, attached to remote volume > 'brick1a'. > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick2a: Connected to 192.168.12.35:6996, attached to remote volume > 'brick2a'. > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick1a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6472:notify] brick2a: got > GF_EVENT_PARENT_UP, attempting connect on transport > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick1a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] D [client-protocol.c:6486:notify] brick2a: got > GF_EVENT_CHILD_UP > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick1a: Connected to 192.168.12.30:6996, attached to remote volume > 'brick1a'. > [2010-01-11 14:16:02] N [afr.c:2194:notify] replicate: Subvolume > 'brick1a' came back up; going online. > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick2a: Connected to 192.168.12.35:6996, attached to remote volume > 'brick2a'. > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick1a: Connected to 192.168.12.30:6996, attached to remote volume > 'brick1a'. > [2010-01-11 14:16:02] N [client-protocol.c:5733:client_setvolume_cbk] > brick2a: Connected to 192.168.12.35:6996, attached to remote volume > 'brick2a'. > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1713:libgf_vmp_map_ghandle] libglusterfsclient: > New Entry: /pub > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1421:libgf_init_vmpentry] libglusterfsclient: > New VMP entry: /pub > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1724:libgf_vmp_map_ghandle] libglusterfsclient: > Empty list > [2010-01-11 14:16:02] D [booster.c:1190:booster_init] booster: booster is > inited > [2010-01-11 14:16:02] D [libglusterfsclient.c:5318:glusterfs_chmod] > libglusterfsclient: path > /home/httpd/apps/httpd-2.2.14/logs/cgisock.29127 > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/apps/httpd-2.2.14/logs/cgisock.29127, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: > /home/httpd/apps/httpd-2.2.14/logs/cgisock.29127 > [2010-01-11 14:16:02] D [libglusterfsclient.c:5443:glusterfs_chown] > libglusterfsclient: path > /home/httpd/apps/httpd-2.2.14/logs/cgisock.29127 > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path > /home/httpd/apps/httpd-2.2.14/logs/cgisock.29127, type: LongestPrefix > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1631:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry not found: path: > /home/httpd/apps/httpd-2.2.14/logs/cgisock.29127 > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1713:libgf_vmp_map_ghandle] libglusterfsclient: > New Entry: /pub > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1421:libgf_init_vmpentry] libglusterfsclient: > New VMP entry: /pub > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1724:libgf_vmp_map_ghandle] libglusterfsclient: > Empty list > [2010-01-11 14:16:02] D [booster.c:1190:booster_init] booster: booster is > inited > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1713:libgf_vmp_map_ghandle] libglusterfsclient: > New Entry: /pub > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1421:libgf_init_vmpentry] libglusterfsclient: > New VMP entry: /pub > [2010-01-11 14:16:02] D > [libglusterfsclient.c:1724:libgf_vmp_map_ghandle] libglusterfsclient: > Empty list > [2010-01-11 14:16:02] D [booster.c:1190:booster_init] booster: booster is > inited > [2010-01-11 14:16:12] D [libglusterfsclient.c:4866:glusterfs_stat] > libglusterfsclient: path /pub/data/tnsc/test/test.mp3 > [2010-01-11 14:16:12] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path /pub/data/tnsc/test/test.mp3, > type: LongestPrefix > [2010-01-11 14:16:12] D > [libglusterfsclient.c:1628:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry found: path :/pub/data/tnsc/test/test.mp3 vmp: /pub/ > [2010-01-11 14:16:12] D [libglusterfsclient.c:4788:__glusterfs_stat] > libglusterfsclient: path /data/tnsc/test/test.mp3, op: 2 > [2010-01-11 14:16:12] D > [libglusterfsclient.c:869:libgf_resolve_path_light] > libglusterfsclient: Path: /data/tnsc/test/test.mp3, Resolved Path: > /data/tnsc/test/test.mp3 > [2010-01-11 14:16:12] D > [libglusterfsclient-dentry.c:268:__do_path_resolve] > libglusterfsclient-dentry: resolved path(/data/tnsc/test/test.mp3) > till 1(/). sending lookup for remaining path > [2010-01-11 14:16:12] D [libglusterfsclient.c:4725:libgf_client_stat] > libglusterfsclient: path /data/tnsc/test/test.mp3, status 0, errno 0 > [2010-01-11 14:16:12] D [libglusterfsclient.c:3001:glusterfs_open] > libglusterfsclient: path /pub/data/tnsc/test/test.mp3 > [2010-01-11 14:16:12] D > [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > libglusterfsclient: VMP Search: path /pub/data/tnsc/test/test.mp3, > type: LongestPrefix > [2010-01-11 14:16:12] D > [libglusterfsclient.c:1628:libgf_vmp_search_entry] libglusterfsclient: > VMP Entry found: path :/pub/data/tnsc/test/test.mp3 vmp: /pub/ > [2010-01-11 14:16:12] D > [libglusterfsclient.c:869:libgf_resolve_path_light] > libglusterfsclient: Path: /data/tnsc/test/test.mp3, Resolved Path: > /data/tnsc/test/test.mp3 > [2010-01-11 14:16:12] D > [libglusterfsclient-dentry.c:389:libgf_client_path_lookup] > libglusterfsclient: resolved path(/data/tnsc/test/test.mp3) to > 1118653312/1118655564 > [2010-01-11 14:16:12] D [libglusterfsclient.c:2752:libgf_client_open] > libglusterfsclient: open: path /data/tnsc/test/test.mp3, status: 0, > errno 117 > > > On Mon, Jan 11, 2010 at 1:23 PM, Raghavendra G <raghavendra.hg at gmail.com> > wrote: > > Hi Liam, > > > > Can you send glusterfs server logs? > > > > regards, > > On Sat, Jan 9, 2010 at 1:46 AM, Liam Slusser <lslusser at gmail.com> wrote: > >> > >> I believe i posted this here before but never got any replies. I'm in > >> the middle of upgrading to Gluster 2.0.9 and would like to move away > >> from having to use fuse to serve up files out of apache so im working > >> again on getting boosting working correctly. > >> > >> Everything appears to load and work fine but i always get permission > >> denied, 403, in my apache logs. Works fine under fuse. I'm running > >> Apache under the user nobody which does have read access to all the > >> files. > >> > >> I'm not sure where to start debugging this? Ideas? > >> > >> thanks, > >> liam > >> > >> I can run things from the command line... > >> > >> [root at server]# > >> > LD_PRELOAD="/home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/glusterfs-booster.so" > >> file /pub/data/tnsc/test/test.mp3 > >> /pub/data/tnsc/test/test.mp3: MPEG ADTS, layer III, v1, 128 kBits, > >> 44.1 kHz, JntStereo > >> > >> [root at server]# > >> > LD_PRELOAD="/home/gluster/apps/glusterfs-2.0.9/lib/glusterfs/glusterfs-booster.so" > >> ls -agl /pub/data/tnsc/test/test.mp3 > >> ls: /pub/data/tnsc/test/test.mp3: Invalid argument > >> -rw-r--r-- 1 user 3692251 Aug 27 2007 /pub/data/tnsc/test/test.mp3 > >> > >> [root at server]# wget -S http://x.x.x.x/tnsc/test/test.mp3 > >> --2010-01-08 13:34:55-- http://x.x.x.x/tnsc/test/test.mp3 > >> Connecting to x.x.x.x:80... connected. > >> HTTP request sent, awaiting response... > >> HTTP/1.1 403 Forbidden > >> Date: Fri, 08 Jan 2010 21:34:55 GMT > >> Server: Apache/2.2.14 (Unix) > >> Content-Length: 228 > >> Keep-Alive: timeout=5, max=100 > >> Connection: Keep-Alive > >> Content-Type: text/html; charset=iso-8859-1 > >> 2010-01-08 13:34:55 ERROR 403: Forbidden. > >> > >> Apache access log: > >> > >> x.x.x.x - - [08/Jan/2010:12:50:46 -0800] "GET /tnsc/test/test.mp3 > >> HTTP/1.0" 403 228 "-" "Wget/1.11.4 Red Hat modified" > >> > >> Apache error log: > >> > >> [Fri Jan 08 12:50:46 2010] [error] [client x..x.x.x] (22)Invalid > >> argument: file permissions deny server access: > >> /pub/data/tnsc/test/test.mp3 > >> > >> Gluster error log: > >> > >> [2010-01-08 12:50:46] D [libglusterfsclient.c:4866:glusterfs_stat] > >> libglusterfsclient: path /pub/data/tnsc/test/test.mp3 > >> [2010-01-08 12:50:46] D > >> [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > >> libglusterfsclient: VMP Search: path /pub/data/tnsc/test/test.mp3, > >> type: LongestPrefix > >> [2010-01-08 12:50:46] D > >> [libglusterfsclient.c:1628:libgf_vmp_search_entry] libglusterfsclient: > >> VMP Entry found: path :/pub/data/tnsc/test/test.mp3 vmp: /pub/ > >> [2010-01-08 12:50:46] D [libglusterfsclient.c:4788:__glusterfs_stat] > >> libglusterfsclient: path /data/tnsc/test/test.mp3, op: 2 > >> [2010-01-08 12:50:46] D > >> [libglusterfsclient.c:869:libgf_resolve_path_light] > >> libglusterfsclient: Path: /data/tnsc/test/test.mp3, Resolved Path: > >> /data/tnsc/test/test.mp3 > >> [2010-01-08 12:50:46] D > >> [libglusterfsclient-dentry.c:389:libgf_client_path_lookup] > >> libglusterfsclient: resolved path(/data/tnsc/test/test.mp3) to > >> 1118653312/1118655564 > >> [2010-01-08 12:50:46] D [libglusterfsclient.c:4710:libgf_client_stat] > >> libglusterfsclient: Cache will be used > >> [2010-01-08 12:50:46] D [libglusterfsclient.c:3001:glusterfs_open] > >> libglusterfsclient: path /pub/data/tnsc/test/test.mp3 > >> [2010-01-08 12:50:46] D > >> [libglusterfsclient.c:1541:_libgf_vmp_search_entry] > >> libglusterfsclient: VMP Search: path /pub/data/tnsc/test/test.mp3, > >> type: LongestPrefix > >> [2010-01-08 12:50:46] D > >> [libglusterfsclient.c:1628:libgf_vmp_search_entry] libglusterfsclient: > >> VMP Entry found: path :/pub/data/tnsc/test/test.mp3 vmp: /pub/ > >> [2010-01-08 12:50:46] D > >> [libglusterfsclient.c:869:libgf_resolve_path_light] > >> libglusterfsclient: Path: /data/tnsc/test/test.mp3, Resolved Path: > >> /data/tnsc/test/test.mp3 > >> [2010-01-08 12:50:46] D > >> [libglusterfsclient-dentry.c:389:libgf_client_path_lookup] > >> libglusterfsclient: resolved path(/data/tnsc/test/test.mp3) to > >> 1118653312/1118655564 > >> [2010-01-08 12:50:46] D [libglusterfsclient.c:2752:libgf_client_open] > >> libglusterfsclient: open: path /data/tnsc/test/test.mp3, status: 0, > >> errno 117 > >> > >> Booster.fstab: > >> > >> > /home/gluster/apps/glusterfs-2.0.9/etc/glusterfs/glusterfs.vol-pub.booster > >> /pub/ glusterfs > >> > >> > subvolume=cache,logfile=/home/gluster/apps/glusterfs-2.0.9/var/log/glusterfs/booster-pub.log,loglevel=DEBUG,attr_timeout=0 > >> > >> glusterfs.vol-pub.booster: > >> > >> volume brick1a > >> type protocol/client > >> option transport-type tcp > >> option remote-host x.x.x.30 > >> option remote-subvolume brick1a > >> end-volume > >> > >> volume brick2a > >> type protocol/client > >> option transport-type tcp > >> option remote-host x.x.x.35 > >> option remote-subvolume brick2a > >> end-volume > >> > >> volume replicate > >> type cluster/replicate > >> subvolumes brick1a brick2a > >> end-volume > >> > >> volume iothreads > >> type performance/io-threads > >> option thread-count 32 > >> subvolumes replicate > >> end-volume > >> > >> volume readahead > >> type performance/read-ahead > >> option page-count 16 # cache per file = (page-count x page-size) > >> option force-atime-update off > >> subvolumes iothreads > >> end-volume > >> > >> volume cache > >> type performance/io-cache > >> option cache-size 512MB > >> subvolumes readahead > >> end-volume > >> > >> httpd.conf: > >> > >> Alias /tnsc/ "/pub/data/tnsc/" > >> <Directory "/pub/data/tnsc/"> > >> Options FollowSymLinks > >> AllowOverride None > >> Order allow,deny > >> Allow from all > >> </Directory> > >> _______________________________________________ > >> Gluster-users mailing list > >> Gluster-users at gluster.org > >> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > > > > > > > > -- > > Raghavendra G > > > > > -- Raghavendra G
