-------- Original-Nachricht -------- > Datum: Tue, 11 Nov 2008 21:07:22 +0100 > Von: "Steve" <steeeeeveee@xxxxxxx> > An: > CC: gluster-devel@xxxxxxxxxx > Betreff: Re: Crash with 1.4.0_pre9 > > Steve, > > > gowda, > gowda, > > > In 1.4.0 pre-releases protocol is undergoing changes and compatibility > > across different versions of client and servers is not guaranteed untill > > stable release. > > > Yes. I know that. That's the reason I compile them here. I want to help to > get a better product :) > > > > You can try running both client and server with same pre-release > version > > of glusterfs. > > > Give me a minute. Will do that and let you know about my success (or > failure). > Okay. You win :) Using glusterfs--mainline--3.0--patch-596 on both of them does NOT produce an crash (so far). One thing I noticed: ---- nemesis ~ # glusterfsd -V glusterfs 1.4.0pre7 built on Nov 11 2008 20:51:23 Repository revision: glusterfs--mainline--3.0--patch-596 Copyright (c) 2006, 2007, 2008 Z RESEARCH Inc. <http://www.zresearch.com> GlusterFS comes with ABSOLUTELY NO WARRANTY. You may redistribute copies of GlusterFS under the terms of the GNU General Public License. nemesis ~ # ---- Should that not be above pre7? I mean pre9 is glusterfs--mainline--3.0--patch-591 so glusterfs--mainline--3.0--patch-596 should be pre9 or higher. Or not? > > > -- > > gowda > > > // Steve > > > > On Wed, Nov 12, 2008 at 1:12 AM, Steve <steeeeeveee@xxxxxxx> wrote: > > > > > I have two GlusterFS servers. One is called nemesis (has IP > > 192.168.0.145) > > > and the other is called spock (has IP 192.168.0.115). > > > > > > I have updated GlusterFS on nemesis to 1.4.0_pre9 and left 1.4.0_pre5 > on > > > spock. After starting GlusterFS server on nemesis I get this error: > > > --- > > > nemesis glusterfs # glusterfsd --no-daemon --log-file=/dev/stdout > > > --log-level=DEBUG > --volume-specfile=/etc/glusterfs/glusterfs-server.vol > > > 2008-11-11 20:14:52 D [glusterfs.c:291:_get_specfp] glusterfs: loading > > > volume specfile /etc/glusterfs/glusterfs-server.vol > > > > > > Version : glusterfs 1.4.0pre9 built on Nov 11 2008 20:08:50 > > > TLA Revision : glusterfs--mainline--3.0--patch-591 > > > Starting Time: 2008-11-11 20:14:52 > > > Command line : glusterfsd --no-daemon --log-file=/dev/stdout > > > --log-level=DEBUG > --volume-specfile=/etc/glusterfs/glusterfs-server.vol > > > given volume specfile > > > +----- > > > 1: ############################################## > > > 2: ### GlusterFS Server Volume Specification ## > > > 3: ### NEMESIS ## > > > 4: ############################################## > > > 5: > > > 6: # dataspace on local > > > 7: volume gfs-ds > > > 8: type storage/posix # POSIX FS > > > translator > > > 9: option directory /local/gfs-brick001 # Export this > > > directoy > > > 10: end-volume > > > 11: > > > 12: # posix locks on local > > > 13: volume gfs-ds-locks > > > 14: type features/posix-locks > > > 15: subvolumes gfs-ds > > > 16: option mandatory on # Enables > > mandatory > > > locking on all files > > > 17: end-volume > > > 18: > > > 19: # dataspace on remote > > > 20: volume gfs-remote-ds > > > 21: type protocol/client > > > 22: option transport-type tcp/client # For TCP/IP transport > > > 23: option remote-host 192.168.0.115 # IP address of the > > remote > > > storage > > > 24: option remote-port 6996 # Default is 6996 > > > 25: option remote-subvolume gfs-ds-locks # Remote > > dataspace > > > 26: option transport-timeout 10 # Value in > > seconds; > > > it should be set relatively low > > > 27: end-volume > > > 28: > > > 29: # automatic file replication translator for dataspace > > > 30: volume gfs-ds-afr > > > 31: type cluster/afr > > > 32: subvolumes gfs-ds-locks gfs-remote-ds # Local and > > remote > > > dataspaces > > > 33: end-volume > > > 34: > > > 35: # the actual exported volume > > > 36: volume gfs > > > 37: type performance/io-threads > > > 38: option thread-count 8 # Deault is 1 > > > 39: option cache-size 64MB # Default is 64MB > > > 40: subvolumes gfs-ds-afr > > > 41: end-volume > > > 42: > > > 43: # server declaration > > > 44: volume server > > > 45: type protocol/server > > > 46: option transport-type tcp/server # For TCP/IP transport > > > 47: option listen-port 6996 # Default is 6996 > > > 48: subvolumes gfs > > > 49: # storage network access only > > > 50: option auth.addr.gfs-ds-locks.allow 192.168.0.*,127.0.0.1 > > > 51: option auth.addr.gfs.allow 192.168.0.* > > > 52: end-volume > > > +----- > > > 2008-11-11 20:14:52 D [spec.y:178:new_section] parser: New node for > > > 'gfs-ds' > > > 2008-11-11 20:14:52 D [xlator.c:367:xlator_set_type] xlator: attempt > to > > > load file /usr/lib/glusterfs/1.4.0pre9/xlator/storage/posix.so > > > 2008-11-11 20:14:52 D [spec.y:202:section_type] parser: > > > Type:gfs-ds:storage/posix > > > 2008-11-11 20:14:52 D [spec.y:268:section_option] parser: > > > Option:gfs-ds:directory:/local/gfs-brick001 > > > 2008-11-11 20:14:52 D [spec.y:350:section_end] parser: end:gfs-ds > > > 2008-11-11 20:14:52 D [spec.y:178:new_section] parser: New node for > > > 'gfs-ds-locks' > > > 2008-11-11 20:14:52 D [xlator.c:367:xlator_set_type] xlator: attempt > to > > > load file /usr/lib/glusterfs/1.4.0pre9/xlator/features/posix-locks.so > > > 2008-11-11 20:14:52 D [xlator.c:407:xlator_set_type] xlator: > > dlsym(notify) > > > on /usr/lib/glusterfs/1.4.0pre9/xlator/features/posix-locks.so: > > undefined > > > symbol: notify -- neglecting > > > 2008-11-11 20:14:52 D [spec.y:202:section_type] parser: > > > Type:gfs-ds-locks:features/posix-locks > > > 2008-11-11 20:14:52 D [spec.y:335:section_sub] parser: > > > child:gfs-ds-locks->gfs-ds > > > 2008-11-11 20:14:52 D [spec.y:268:section_option] parser: > > > Option:gfs-ds-locks:mandatory:on > > > 2008-11-11 20:14:52 D [spec.y:350:section_end] parser: > end:gfs-ds-locks > > > 2008-11-11 20:14:52 D [spec.y:178:new_section] parser: New node for > > > 'gfs-remote-ds' > > > 2008-11-11 20:14:52 D [xlator.c:367:xlator_set_type] xlator: attempt > to > > > load file /usr/lib/glusterfs/1.4.0pre9/xlator/protocol/client.so > > > 2008-11-11 20:14:52 D [spec.y:202:section_type] parser: > > > Type:gfs-remote-ds:protocol/client > > > 2008-11-11 20:14:52 D [spec.y:268:section_option] parser: > > > Option:gfs-remote-ds:transport-type:tcp/client > > > 2008-11-11 20:14:52 D [spec.y:268:section_option] parser: > > > Option:gfs-remote-ds:remote-host:192.168.0.115 > > > 2008-11-11 20:14:52 D [spec.y:268:section_option] parser: > > > Option:gfs-remote-ds:remote-port:6996 > > > 2008-11-11 20:14:52 D [spec.y:268:section_option] parser: > > > Option:gfs-remote-ds:remote-subvolume:gfs-ds-locks > > > 2008-11-11 20:14:52 D [spec.y:268:section_option] parser: > > > Option:gfs-remote-ds:transport-timeout:10 > > > 2008-11-11 20:14:52 D [spec.y:350:section_end] parser: > end:gfs-remote-ds > > > 2008-11-11 20:14:52 D [spec.y:178:new_section] parser: New node for > > > 'gfs-ds-afr' > > > 2008-11-11 20:14:52 D [xlator.c:367:xlator_set_type] xlator: attempt > to > > > load file /usr/lib/glusterfs/1.4.0pre9/xlator/cluster/afr.so > > > 2008-11-11 20:14:52 D [spec.y:202:section_type] parser: > > > Type:gfs-ds-afr:cluster/afr > > > 2008-11-11 20:14:52 D [spec.y:335:section_sub] parser: > > > child:gfs-ds-afr->gfs-ds-locks > > > 2008-11-11 20:14:52 D [spec.y:335:section_sub] parser: > > > child:gfs-ds-afr->gfs-remote-ds > > > 2008-11-11 20:14:52 D [spec.y:350:section_end] parser: end:gfs-ds-afr > > > 2008-11-11 20:14:52 D [spec.y:178:new_section] parser: New node for > > 'gfs' > > > 2008-11-11 20:14:52 D [xlator.c:367:xlator_set_type] xlator: attempt > to > > > load file > /usr/lib/glusterfs/1.4.0pre9/xlator/performance/io-threads.so > > > 2008-11-11 20:14:52 D [xlator.c:407:xlator_set_type] xlator: > > dlsym(notify) > > > on /usr/lib/glusterfs/1.4.0pre9/xlator/performance/io-threads.so: > > undefined > > > symbol: notify -- neglecting > > > 2008-11-11 20:14:52 D [spec.y:202:section_type] parser: > > > Type:gfs:performance/io-threads > > > 2008-11-11 20:14:52 D [spec.y:268:section_option] parser: > > > Option:gfs:thread-count:8 > > > 2008-11-11 20:14:52 D [spec.y:268:section_option] parser: > > > Option:gfs:cache-size:64MB > > > 2008-11-11 20:14:52 D [spec.y:335:section_sub] parser: > > > child:gfs->gfs-ds-afr > > > 2008-11-11 20:14:52 D [spec.y:350:section_end] parser: end:gfs > > > 2008-11-11 20:14:52 D [spec.y:178:new_section] parser: New node for > > > 'server' > > > 2008-11-11 20:14:52 D [xlator.c:367:xlator_set_type] xlator: attempt > to > > > load file /usr/lib/glusterfs/1.4.0pre9/xlator/protocol/server.so > > > 2008-11-11 20:14:52 D [spec.y:202:section_type] parser: > > > Type:server:protocol/server > > > 2008-11-11 20:14:52 D [spec.y:268:section_option] parser: > > > Option:server:transport-type:tcp/server > > > 2008-11-11 20:14:52 D [spec.y:268:section_option] parser: > > > Option:server:listen-port:6996 > > > 2008-11-11 20:14:52 D [spec.y:335:section_sub] parser: > child:server->gfs > > > 2008-11-11 20:14:52 D [spec.y:268:section_option] parser: > > > Option:server:auth.addr.gfs-ds-locks.allow:192.168.0.*,127.0.0.1 > > > 2008-11-11 20:14:52 D [spec.y:268:section_option] parser: > > > Option:server:auth.addr.gfs.allow:192.168.0.* > > > 2008-11-11 20:14:52 D [spec.y:350:section_end] parser: end:server > > > 2008-11-11 20:14:52 D [glusterfs.c:814:main] glusterfs: running in pid > > > 19898 > > > > > > 2008-11-11 20:14:52 D [transport.c:104:transport_load] transport: > > attempt > > > to load file /usr/lib/glusterfs/1.4.0pre9/transport/socket.so > > > 2008-11-11 20:14:52 D [server-protocol.c:7367:init] server: defaulting > > > limits.transaction-size to 4194304 > > > 2008-11-11 20:14:52 D [xlator.c:491:xlator_init_rec] gfs-ds: > > Initialization > > > done > > > 2008-11-11 20:14:52 D [xlator.c:491:xlator_init_rec] gfs-ds-locks: > > > Initialization done > > > 2008-11-11 20:14:52 D [client-protocol.c:4988:init] gfs-remote-ds: > > setting > > > transport-timeout to 10 > > > 2008-11-11 20:14:52 D [transport.c:104:transport_load] transport: > > attempt > > > to load file /usr/lib/glusterfs/1.4.0pre9/transport/socket.so > > > 2008-11-11 20:14:52 D [client-protocol.c:5032:init] gfs-remote-ds: > > > defaulting limits.transaction-size to 268435456 > > > 2008-11-11 20:14:52 D [xlator.c:491:xlator_init_rec] gfs-remote-ds: > > > Initialization done > > > 2008-11-11 20:14:52 D [xlator.c:491:xlator_init_rec] gfs-ds-afr: > > > Initialization done > > > 2008-11-11 20:14:52 D [io-threads.c:1174:init] io-threads: Using > > > conf->thread_count = 8 > > > 2008-11-11 20:14:52 D [io-threads.c:1203:init] io-threads: Using > > > conf->cache_size = 67108864 > > > 2008-11-11 20:14:52 D [client-protocol.c:5264:notify] gfs-remote-ds: > got > > > GF_EVENT_PARENT_UP, attempting connect on transport > > > 2008-11-11 20:14:52 D [client-protocol.c:5264:notify] gfs-remote-ds: > got > > > GF_EVENT_PARENT_UP, attempting connect on transport > > > 2008-11-11 20:14:52 D > [client-protocol.c:4680:client_protocol_reconnect] > > > gfs-remote-ds: attempting reconnect > > > 2008-11-11 20:14:52 D [common-utils.c:213:gf_resolve_ip6] resolver: > DNS > > > cache not present, freshly probing hostname: 192.168.0.115 > > > 2008-11-11 20:14:52 D [common-utils.c:250:gf_resolve_ip6] resolver: > > > returning ip-192.168.0.115 (port-6996) for hostname: 192.168.0.115 and > > > port: 6996 > > > 2008-11-11 20:14:52 D [client-protocol.c:5301:notify] gfs-remote-ds: > got > > > GF_EVENT_CHILD_UP > > > 2008-11-11 20:14:52 D [socket.c:924:socket_connect] gfs-remote-ds: > > connect > > > () called on transport already connected > > > 2008-11-11 20:14:52 W [common-utils.c:156:gf_print_bytes] glusterfs: > > Total > > > data (in bytes): transfered (258), received (152) > > > pending frames: > > > frame : type(2) op(0) > > > > > > Signal received: 11 > > > configuration details:argp 1 > > > backtrace 1 > > > dlfcn 1 > > > fdatasync 1 > > > libpthread 1 > > > llistxattr 1 > > > setfsid 1 > > > spinlock 1 > > > epoll.h 1 > > > xattr.h 1 > > > tv_nsec 1 > > > package-string: glusterfs 1.4.0pre9 > > > [0xb7ef9400] > > > > > > > > > /usr/lib/glusterfs/1.4.0pre9/xlator/protocol/client.so(protocol_client_interpret+0x1c1)[0xb7cceb27] > > > > > > > > > /usr/lib/glusterfs/1.4.0pre9/xlator/protocol/client.so(protocol_client_pollin+0xe4)[0xb7ccf56f] > > > > > > > > > /usr/lib/glusterfs/1.4.0pre9/xlator/protocol/client.so(notify+0x73)[0xb7ccf608] > > > /usr/lib/glusterfs/1.4.0pre9/transport/socket.so[0xb746f97d] > > > /usr/lib/glusterfs/1.4.0pre9/transport/socket.so[0xb746fc7c] > > > /usr/lib/libglusterfs.so.0[0xb7ee4036] > > > /usr/lib/libglusterfs.so.0(event_dispatch+0x7a)[0xb7ee435a] > > > glusterfsd(main+0xd97)[0x804bab8] > > > /lib/libc.so.6(__libc_start_main+0xfa)[0xb7d4a42a] > > > --------- > > > Segmentation fault (core dumped) > > > nemesis glusterfs # > > > --- > > > > > > > > > > > > This is the full stacktrace of the dumped core on nemesis: > > > --- > > > nemesis glusterfs # gdb /usr/sbin/glusterfsd /var/tmp/19898 > > > GNU gdb 6.8 > > > Copyright (C) 2008 Free Software Foundation, Inc. > > > License GPLv3+: GNU GPL version 3 or later < > > > http://gnu.org/licenses/gpl.html> > > > This is free software: you are free to change and redistribute it. > > > There is NO WARRANTY, to the extent permitted by law. Type "show > > copying" > > > and "show warranty" for details. > > > This GDB was configured as "i686-pc-linux-gnu"... > > > > > > warning: Can't read pathname for load map: Input/output error. > > > Reading symbols from /usr/lib/libglusterfs.so.0...Reading symbols from > > > /usr/lib/debug/usr/lib/libglusterfs.so.0.0.0.debug...done. > > > done. > > > Loaded symbols for /usr/lib/libglusterfs.so.0 > > > Reading symbols from /lib/libdl.so.2...Reading symbols from > > > /usr/lib/debug/lib/libdl-2.7.so.debug...done. > > > done. > > > Loaded symbols for /lib/libdl.so.2 > > > Reading symbols from /lib/libpthread.so.0...Reading symbols from > > > /usr/lib/debug/lib/libpthread-2.7.so.debug...done. > > > done. > > > Loaded symbols for /lib/libpthread.so.0 > > > Reading symbols from /lib/libc.so.6...Reading symbols from > > > /usr/lib/debug/lib/libc-2.7.so.debug...done. > > > done. > > > Loaded symbols for /lib/libc.so.6 > > > Reading symbols from /lib/ld-linux.so.2...Reading symbols from > > > /usr/lib/debug/lib/ld-2.7.so.debug...done. > > > done. > > > Loaded symbols for /lib/ld-linux.so.2 > > > Reading symbols from > > > /usr/lib/glusterfs/1.4.0pre9/xlator/storage/posix.so...Reading symbols > > from > > > > > > /usr/lib/debug/usr/lib/glusterfs/1.4.0pre9/xlator/storage/posix.so.0.0.0.debug...done. > > > done. > > > Loaded symbols for > /usr/lib/glusterfs/1.4.0pre9/xlator/storage/posix.so > > > Reading symbols from > > > /usr/lib/glusterfs/1.4.0pre9/xlator/features/posix-locks.so...Reading > > > symbols from > > > > > > /usr/lib/debug/usr/lib/glusterfs/1.4.0pre9/xlator/features/posix-locks.so.0.0.0.debug...done. > > > done. > > > Loaded symbols for > > > /usr/lib/glusterfs/1.4.0pre9/xlator/features/posix-locks.so > > > Reading symbols from > > > /usr/lib/glusterfs/1.4.0pre9/xlator/protocol/client.so...Reading > symbols > > > from > > > > > > /usr/lib/debug/usr/lib/glusterfs/1.4.0pre9/xlator/protocol/client.so.0.0.0.debug...done. > > > done. > > > Loaded symbols for > > /usr/lib/glusterfs/1.4.0pre9/xlator/protocol/client.so > > > Reading symbols from > > > /usr/lib/glusterfs/1.4.0pre9/xlator/cluster/afr.so...Reading symbols > > from > > > > > > /usr/lib/debug/usr/lib/glusterfs/1.4.0pre9/xlator/cluster/afr.so.0.0.0.debug...done. > > > done. > > > Loaded symbols for /usr/lib/glusterfs/1.4.0pre9/xlator/cluster/afr.so > > > Reading symbols from > > > > /usr/lib/glusterfs/1.4.0pre9/xlator/performance/io-threads.so...Reading > > > symbols from > > > > > > /usr/lib/debug/usr/lib/glusterfs/1.4.0pre9/xlator/performance/io-threads.so.0.0.0.debug...done. > > > done. > > > Loaded symbols for > > > /usr/lib/glusterfs/1.4.0pre9/xlator/performance/io-threads.so > > > Reading symbols from > > > /usr/lib/glusterfs/1.4.0pre9/xlator/protocol/server.so...Reading > symbols > > > from > > > > > > /usr/lib/debug/usr/lib/glusterfs/1.4.0pre9/xlator/protocol/server.so.0.0.0.debug...done. > > > done. > > > Loaded symbols for > > /usr/lib/glusterfs/1.4.0pre9/xlator/protocol/server.so > > > Reading symbols from > > > /usr/lib/glusterfs/1.4.0pre9/transport/socket.so...Reading symbols > from > > > > > > /usr/lib/debug/usr/lib/glusterfs/1.4.0pre9/transport/socket.so.0.0.0.debug...done. > > > done. > > > Loaded symbols for /usr/lib/glusterfs/1.4.0pre9/transport/socket.so > > > Reading symbols from > /usr/lib/glusterfs/1.4.0pre9/auth/addr.so...Reading > > > symbols from > > > > > > /usr/lib/debug/usr/lib/glusterfs/1.4.0pre9/auth/addr.so.0.0.0.debug...done. > > > done. > > > Loaded symbols for /usr/lib/glusterfs/1.4.0pre9/auth/addr.so > > > Reading symbols from /lib/libnss_files.so.2...Reading symbols from > > > /usr/lib/debug/lib/libnss_files-2.7.so.debug...done. > > > done. > > > Loaded symbols for /lib/libnss_files.so.2 > > > Reading symbols from > > > /usr/lib/gcc/i686-pc-linux-gnu/4.3.2/libgcc_s.so.1...done. > > > Loaded symbols for /usr/lib/gcc/i686-pc-linux-gnu/4.3.2/libgcc_s.so.1 > > > Core was generated by `glusterfsd --no-daemon --log-file=/dev/stdout > > > --log-level=DEBUG --volume-specfi'. > > > Program terminated with signal 11, Segmentation fault. > > > [New process 19898] > > > [New process 19907] > > > [New process 19901] > > > [New process 19902] > > > [New process 19903] > > > [New process 19904] > > > [New process 19900] > > > [New process 19905] > > > [New process 19906] > > > [New process 19899] > > > #0 0xb7ccab4c in client_stat_cbk (frame=0x805ac80, hdr=0x805ab88, > > > hdrlen=140, buf=0x0, buflen=0) at client-protocol.c:3085 > > > 3085 client-protocol.c: No such file or directory. > > > in client-protocol.c > > > (gdb) bt full > > > #0 0xb7ccab4c in client_stat_cbk (frame=0x805ac80, hdr=0x805ab88, > > > hdrlen=140, buf=0x0, buflen=0) at client-protocol.c:3085 > > > fn = (ret_fn_t) 0 > > > _parent = (call_frame_t *) 0x0 > > > stbuf = {st_dev = 0, __pad1 = 0, __st_ino = 0, st_mode = 0, > > st_nlink > > > = 0, st_uid = 0, st_gid = 0, st_rdev = 0, > > > __pad2 = 0, st_size = 0, st_blksize = 0, st_blocks = 0, st_atim = > > {tv_sec > > > = 0, tv_nsec = 0}, st_mtim = {tv_sec = 0, > > > tv_nsec = 0}, st_ctim = {tv_sec = 0, tv_nsec = 0}, st_ino = 0} > > > rsp = (gf_fop_stat_rsp_t *) 0x805aba8 > > > op_ret = -1 > > > op_errno = 22 > > > #1 0xb7cceb27 in protocol_client_interpret (this=0x80552c0, > > > trans=0x8057818, hdr_p=0x805ab88 "", hdrlen=140, buf_p=0x0, > > > buflen=0) at client-protocol.c:4929 > > > ret = -1 > > > frame = (call_frame_t *) 0x805ac80 > > > hdr = (gf_hdr_common_t *) 0x805ab88 > > > callid = 2 > > > type = 4 > > > op = 0 > > > __FUNCTION__ = "protocol_client_interpret" > > > #2 0xb7ccf56f in protocol_client_pollin (this=0x80552c0, > > trans=0x8057818) > > > at client-protocol.c:5165 > > > priv = (client_proto_priv_t *) 0x8057a88 > > > ret = 0 > > > buf = 0x0 > > > buflen = 0 > > > hdr = 0x805ab88 "" > > > hdrlen = 140 > > > connected = 0 > > > #3 0xb7ccf608 in notify (this=0x80552c0, event=2, data=0x8057818) at > > > client-protocol.c:5207 > > > priv = (client_proto_priv_t *) 0x80500c8 > > > ret = -1 > > > trans = (transport_t *) 0x8057818 > > > __FUNCTION__ = "notify" > > > #4 0xb746f97d in socket_event_poll_in (this=0x8057818) at > socket.c:678 > > > ret = 0 > > > #5 0xb746fc7c in socket_event_handler (fd=7, idx=1, data=0x8057818, > > > poll_in=1, poll_out=0, poll_err=0) at socket.c:778 > > > this = (transport_t *) 0x8057818 > > > priv = (socket_private_t *) 0x8057b28 > > > ret = 0 > > > #6 0xb7ee4036 in event_dispatch_epoll (event_pool=0x80500c8) at > > > event.c:853 > > > event_data = (struct event_data *) 0x80595cc > > > handler = (event_handler_t) 0xb746fbd7 <socket_event_handler> > > > data = (void *) 0x8057818 > > > idx = 1 > > > events = (struct epoll_event *) 0x80595c8 > > > ---Type <return> to continue, or q <return> to quit--- > > > size = 1 > > > i = 0 > > > ret = 1 > > > __FUNCTION__ = "event_dispatch_epoll" > > > #7 0xb7ee435a in event_dispatch (event_pool=0x80500c8) at event.c:959 > > > __FUNCTION__ = "event_dispatch" > > > #8 0x0804bab8 in main (argc=5, argv=0xbfb18694) at glusterfs.c:835 > > > rv = 0 > > > ctx = (glusterfs_ctx_t *) 0x8050008 > > > cmd_args = (cmd_args_t *) 0x8050008 > > > pool = (call_pool_t *) 0x8050140 > > > stbuf = {st_dev = 3216082440, __pad1 = 34300, __st_ino = 0, > > st_mode > > > = 0, st_nlink = 0, st_uid = 0, st_gid = 0, > > > st_rdev = 0, __pad2 = 0, st_size = -5192203587464100288, st_blksize = > > > 134516962, st_blocks = 1, st_atim = {tv_sec = 0, > > > tv_nsec = 0}, st_mtim = {tv_sec = 0, tv_nsec = 0}, st_ctim = > {tv_sec > > = > > > 0, tv_nsec = 0}, st_ino = 0} > > > tmp_logfile = '\0' <repeats 1023 times> > > > timestr = '\0' <repeats 255 times> > > > base_exec_name = 0x80500a8 "/dev/stdout" > > > utime = 0 > > > tm = (struct tm *) 0x0 > > > ret = 0 > > > lim = {rlim_cur = 18446744073709551615, rlim_max = > > > 18446744073709551615} > > > specfp = (FILE *) 0x8050390 > > > graph = (xlator_t *) 0x8056498 > > > trav = (xlator_t *) 0x8056498 > > > fuse_volume_found = 0 > > > server_or_fuse_found = 1 > > > __FUNCTION__ = "main" > > > (gdb) quit > > > nemesis glusterfs # > > > --- > > > > > > > > > > > > On the second node where I run GlusterFS server (host spock) I get > this > > > debug output while running the server and attempting to connect from > > > nemesis: > > > ---- > > > mail ~ # glusterfsd --no-daemon --log-file=/dev/stdout > --log-level=DEBUG > > > --volume-specfile=/etc/glusterfs/glusterfs-server.vol > > > 2008-11-11 20:23:10 D [glusterfs.c:271:_get_specfp] glusterfsd: > loading > > > volume specfile /etc/glusterfs/glusterfs-server.vol > > > > > > Version : glusterfs 1.4.0pre5 built on Nov 6 2008 16:26:05 > > > TLA Revision : glusterfs--mainline--3.0--patch-359 > > > Starting Time: 2008-11-11 20:23:10 > > > Command line : glusterfsd --no-daemon --log-file=/dev/stdout > > > --log-level=DEBUG > --volume-specfile=/etc/glusterfs/glusterfs-server.vol > > > given volume specfile > > > +----- > > > 1: ############################################## > > > 2: ### GlusterFS Server Volume Specification ## > > > 3: ### SPOCK ## > > > 4: ############################################## > > > 5: > > > 6: # dataspace on local > > > 7: volume gfs-ds > > > 8: type storage/posix # POSIX FS > > > translator > > > 9: option directory /local/gfs-brick001 # Export this > > > directoy > > > 10: end-volume > > > 11: > > > 12: # posix locks on local > > > 13: volume gfs-ds-locks > > > 14: type features/posix-locks > > > 15: subvolumes gfs-ds > > > 16: option mandatory on # Enables > > mandatory > > > locking on all files > > > 17: end-volume > > > 18: > > > 19: # dataspace on remote > > > 20: volume gfs-remote-ds > > > 21: type protocol/client > > > 22: option transport-type tcp/client # For TCP/IP transport > > > 23: option remote-host 192.168.0.145 # IP address of the > > remote > > > storage > > > 24: option remote-port 6996 # Default is 6996 > > > 25: option remote-subvolume gfs-ds-locks # Remote > > dataspace > > > 26: option transport-timeout 10 # Value in > > seconds; > > > it should be set relatively low > > > 27: end-volume > > > 28: > > > 29: # automatic file replication translator for dataspace > > > 30: volume gfs-ds-afr > > > 31: type cluster/afr > > > 32: subvolumes gfs-ds-locks gfs-remote-ds # Local and > > remote > > > dataspaces > > > 33: end-volume > > > 34: > > > 35: # the actual exported volume > > > 36: volume gfs > > > 37: type performance/io-threads > > > 38: option thread-count 8 # Deault is 1 > > > 39: option cache-size 64MB # Default is 64MB > > > 40: subvolumes gfs-ds-afr > > > 41: end-volume > > > 42: > > > 43: # server declaration > > > 44: volume server > > > 45: type protocol/server > > > 46: option transport-type tcp/server # For TCP/IP transport > > > 47: option listen-port 6996 # Default is 6996 > > > 48: subvolumes gfs > > > 49: # storage network access only > > > 50: option auth.addr.gfs-ds-locks.allow 192.168.0.*,127.0.0.1 > > > 51: option auth.addr.gfs.allow 192.168.0.* > > > 52: end-volume > > > +----- > > > 2008-11-11 20:23:10 D [spec.y:194:new_section] parser: New node for > > > 'gfs-ds' > > > 2008-11-11 20:23:10 D [xlator.c:289:xlator_set_type] xlator: attempt > to > > > load file /usr/lib/glusterfs/1.4.0pre5/xlator/storage/posix.so > > > 2008-11-11 20:23:11 D [spec.y:219:section_type] parser: > > > Type:gfs-ds:storage/posix > > > 2008-11-11 20:23:11 D [spec.y:285:section_option] parser: > > > Option:gfs-ds:directory:/local/gfs-brick001 > > > 2008-11-11 20:23:11 D [spec.y:367:section_end] parser: end:gfs-ds > > > 2008-11-11 20:23:11 D [spec.y:194:new_section] parser: New node for > > > 'gfs-ds-locks' > > > 2008-11-11 20:23:11 D [xlator.c:289:xlator_set_type] xlator: attempt > to > > > load file /usr/lib/glusterfs/1.4.0pre5/xlator/features/posix-locks.so > > > 2008-11-11 20:23:11 D [xlator.c:318:xlator_set_type] gfs-ds-locks: > > > dlsym(notify) on > > > /usr/lib/glusterfs/1.4.0pre5/xlator/features/posix-locks.so: undefined > > > symbol: notify -- neglecting > > > 2008-11-11 20:23:11 D [spec.y:219:section_type] parser: > > > Type:gfs-ds-locks:features/posix-locks > > > 2008-11-11 20:23:11 D [spec.y:352:section_sub] parser: > > > child:gfs-ds-locks->gfs-ds > > > 2008-11-11 20:23:11 D [spec.y:285:section_option] parser: > > > Option:gfs-ds-locks:mandatory:on > > > 2008-11-11 20:23:11 D [spec.y:367:section_end] parser: > end:gfs-ds-locks > > > 2008-11-11 20:23:11 D [spec.y:194:new_section] parser: New node for > > > 'gfs-remote-ds' > > > 2008-11-11 20:23:11 D [xlator.c:289:xlator_set_type] xlator: attempt > to > > > load file /usr/lib/glusterfs/1.4.0pre5/xlator/protocol/client.so > > > 2008-11-11 20:23:11 D [spec.y:219:section_type] parser: > > > Type:gfs-remote-ds:protocol/client > > > 2008-11-11 20:23:11 D [spec.y:285:section_option] parser: > > > Option:gfs-remote-ds:transport-type:tcp/client > > > 2008-11-11 20:23:11 D [spec.y:285:section_option] parser: > > > Option:gfs-remote-ds:remote-host:192.168.0.145 > > > 2008-11-11 20:23:11 D [spec.y:285:section_option] parser: > > > Option:gfs-remote-ds:remote-port:6996 > > > 2008-11-11 20:23:11 D [spec.y:285:section_option] parser: > > > Option:gfs-remote-ds:remote-subvolume:gfs-ds-locks > > > 2008-11-11 20:23:11 D [spec.y:285:section_option] parser: > > > Option:gfs-remote-ds:transport-timeout:10 > > > 2008-11-11 20:23:11 D [spec.y:367:section_end] parser: > end:gfs-remote-ds > > > 2008-11-11 20:23:11 D [spec.y:194:new_section] parser: New node for > > > 'gfs-ds-afr' > > > 2008-11-11 20:23:11 D [xlator.c:289:xlator_set_type] xlator: attempt > to > > > load file /usr/lib/glusterfs/1.4.0pre5/xlator/cluster/afr.so > > > 2008-11-11 20:23:11 D [xlator.c:324:xlator_set_type] gfs-ds-afr: > strict > > > option validation is not enforced -- neglecting > > > 2008-11-11 20:23:11 D [spec.y:219:section_type] parser: > > > Type:gfs-ds-afr:cluster/afr > > > 2008-11-11 20:23:11 D [spec.y:352:section_sub] parser: > > > child:gfs-ds-afr->gfs-ds-locks > > > 2008-11-11 20:23:11 D [spec.y:352:section_sub] parser: > > > child:gfs-ds-afr->gfs-remote-ds > > > 2008-11-11 20:23:11 D [spec.y:367:section_end] parser: end:gfs-ds-afr > > > 2008-11-11 20:23:11 D [spec.y:194:new_section] parser: New node for > > 'gfs' > > > 2008-11-11 20:23:11 D [xlator.c:289:xlator_set_type] xlator: attempt > to > > > load file > /usr/lib/glusterfs/1.4.0pre5/xlator/performance/io-threads.so > > > 2008-11-11 20:23:11 D [xlator.c:318:xlator_set_type] gfs: > dlsym(notify) > > on > > > /usr/lib/glusterfs/1.4.0pre5/xlator/performance/io-threads.so: > undefined > > > symbol: notify -- neglecting > > > 2008-11-11 20:23:11 D [spec.y:219:section_type] parser: > > > Type:gfs:performance/io-threads > > > 2008-11-11 20:23:11 D [spec.y:285:section_option] parser: > > > Option:gfs:thread-count:8 > > > 2008-11-11 20:23:11 D [spec.y:285:section_option] parser: > > > Option:gfs:cache-size:64MB > > > 2008-11-11 20:23:11 D [spec.y:352:section_sub] parser: > > > child:gfs->gfs-ds-afr > > > 2008-11-11 20:23:11 D [spec.y:367:section_end] parser: end:gfs > > > 2008-11-11 20:23:11 D [spec.y:194:new_section] parser: New node for > > > 'server' > > > 2008-11-11 20:23:11 D [xlator.c:289:xlator_set_type] xlator: attempt > to > > > load file /usr/lib/glusterfs/1.4.0pre5/xlator/protocol/server.so > > > 2008-11-11 20:23:11 D [spec.y:219:section_type] parser: > > > Type:server:protocol/server > > > 2008-11-11 20:23:11 D [spec.y:285:section_option] parser: > > > Option:server:transport-type:tcp/server > > > 2008-11-11 20:23:11 D [spec.y:285:section_option] parser: > > > Option:server:listen-port:6996 > > > 2008-11-11 20:23:11 D [spec.y:352:section_sub] parser: > child:server->gfs > > > 2008-11-11 20:23:11 D [spec.y:285:section_option] parser: > > > Option:server:auth.addr.gfs-ds-locks.allow:192.168.0.*,127.0.0.1 > > > 2008-11-11 20:23:11 D [spec.y:285:section_option] parser: > > > Option:server:auth.addr.gfs.allow:192.168.0.* > > > 2008-11-11 20:23:11 D [spec.y:367:section_end] parser: end:server > > > 2008-11-11 20:23:11 D [glusterfs.c:771:main] glusterfsd: running in > pid > > > 17646 > > > > > > 2008-11-11 20:23:11 D [transport.c:104:transport_load] transport: > > attempt > > > to load file /usr/lib/glusterfs/1.4.0pre5/transport/socket.so > > > 2008-11-11 20:23:11 D [server-protocol.c:6267:init] server: defaulting > > > limits.transaction-size to 4194304 > > > 2008-11-11 20:23:11 D [client-protocol.c:4383:init] gfs-remote-ds: > > setting > > > transport-timeout to 10 > > > 2008-11-11 20:23:11 D [transport.c:104:transport_load] transport: > > attempt > > > to load file /usr/lib/glusterfs/1.4.0pre5/transport/socket.so > > > 2008-11-11 20:23:11 D [client-protocol.c:4427:init] gfs-remote-ds: > > > defaulting limits.transaction-size to 268435456 > > > 2008-11-11 20:23:11 D [afr.c:6397:init] gfs-ds-afr: self-heal is > enabled > > > (default) > > > 2008-11-11 20:23:11 D [afr.c:6425:init] gfs-ds-afr: (default) reads > will > > be > > > scheduled between the children > > > 2008-11-11 20:23:11 D [afr.c:6309:notify] gfs-ds-afr: > GF_EVENT_CHILD_UP > > > from gfs-ds-locks > > > 2008-11-11 20:23:11 D [afr.c:6241:afr_check_xattr_cbk] gfs-ds-afr: > > > 'gfs-ds-locks' supports Extended attribute > > > 2008-11-11 20:23:11 D [client-protocol.c:4653:notify] gfs-remote-ds: > got > > > GF_EVENT_PARENT_UP, attempting connect on transport > > > 2008-11-11 20:23:11 D [io-threads.c:1229:init] io-threads: Using > > > conf->thread_count = 8 > > > 2008-11-11 20:23:11 D [io-threads.c:1262:init] io-threads: Using > > > conf->cache_size = -5192566377910632448 > > > 2008-11-11 20:23:11 D > [client-protocol.c:4126:client_protocol_reconnect] > > > gfs-remote-ds: attempting reconnect > > > 2008-11-11 20:23:11 D [common-utils.c:215:gf_resolve_ip6] resolver: > DNS > > > cache not present, freshly probing hostname: 192.168.0.145 > > > 2008-11-11 20:23:11 D [common-utils.c:252:gf_resolve_ip6] resolver: > > > returning ip-192.168.0.145 (port-6996) for hostname: 192.168.0.145 and > > > port: 6996 > > > 2008-11-11 20:23:11 E [socket.c:708:socket_connect_finish] > > gfs-remote-ds: > > > connection failed (Connection refused) > > > 2008-11-11 20:23:11 D [socket.c:183:__socket_disconnect] > gfs-remote-ds: > > > shutdown() returned -1. setting connection state to -1 > > > 2008-11-11 20:23:11 D [client-protocol.c:4153:protocol_client_cleanup] > > > gfs-remote-ds: cleaning up state in transport object 0xb7f41608 > > > 2008-11-11 20:23:11 D [client-protocol.c:4179:protocol_client_cleanup] > > > gfs-remote-ds: priv->timer is NULL!!!! > > > 2008-11-11 20:23:11 W [socket.c:93:__socket_rwv] gfs-remote-ds: EOF > from > > > peer > > > 2008-11-11 20:23:11 D [socket.c:568:socket_proto_state_machine] > > > gfs-remote-ds: socket read failed (Transport endpoint is not > connected) > > in > > > state 1 () > > > 2008-11-11 20:23:11 D [client-protocol.c:4153:protocol_client_cleanup] > > > gfs-remote-ds: cleaning up state in transport object 0xb7f41608 > > > 2008-11-11 20:23:11 D [client-protocol.c:4179:protocol_client_cleanup] > > > gfs-remote-ds: priv->timer is NULL!!!! > > > 2008-11-11 20:23:12 D > [client-protocol.c:4126:client_protocol_reconnect] > > > gfs-remote-ds: attempting reconnect > > > 2008-11-11 20:23:12 D [common-utils.c:208:gf_resolve_ip6] resolver: > > > flushing DNS cache > > > 2008-11-11 20:23:12 D [common-utils.c:215:gf_resolve_ip6] resolver: > DNS > > > cache not present, freshly probing hostname: 192.168.0.145 > > > 2008-11-11 20:23:12 D [common-utils.c:252:gf_resolve_ip6] resolver: > > > returning ip-192.168.0.145 (port-6996) for hostname: 192.168.0.145 and > > > port: 6996 > > > 2008-11-11 20:23:12 D [socket.c:183:__socket_disconnect] > gfs-remote-ds: > > > shutdown() returned -1. setting connection state to -1 > > > 2008-11-11 20:23:12 D [client-protocol.c:4153:protocol_client_cleanup] > > > gfs-remote-ds: cleaning up state in transport object 0xb7f41608 > > > 2008-11-11 20:23:12 D [client-protocol.c:4179:protocol_client_cleanup] > > > gfs-remote-ds: priv->timer is NULL!!!! > > > 2008-11-11 20:23:12 W [socket.c:93:__socket_rwv] gfs-remote-ds: EOF > from > > > peer > > > 2008-11-11 20:23:12 D [socket.c:568:socket_proto_state_machine] > > > gfs-remote-ds: socket read failed (Transport endpoint is not > connected) > > in > > > state 1 () > > > 2008-11-11 20:23:12 D [client-protocol.c:4153:protocol_client_cleanup] > > > gfs-remote-ds: cleaning up state in transport object 0xb7f41608 > > > 2008-11-11 20:23:12 D [client-protocol.c:4179:protocol_client_cleanup] > > > gfs-remote-ds: priv->timer is NULL!!!! > > > 2008-11-11 20:23:14 W [socket.c:93:__socket_rwv] server: EOF from peer > > > 192.168.0.144:1023 > > > 2008-11-11 20:23:14 D [socket.c:568:socket_proto_state_machine] > server: > > > socket read failed (Transport endpoint is not connected) in state 1 ( > > > 192.168.0.144:1023) > > > 2008-11-11 20:23:14 D [server-protocol.c:6182:server_protocol_cleanup] > > > server: cleaned up transport state for client 192.168.0.144:1023 > > > 2008-11-11 20:23:14 D [socket.c:1287:fini] server: transport > 0xb7f44a50 > > > destroyed > > > 2008-11-11 20:23:14 D > [client-protocol.c:4126:client_protocol_reconnect] > > > gfs-remote-ds: attempting reconnect > > > 2008-11-11 20:23:14 D [common-utils.c:208:gf_resolve_ip6] resolver: > > > flushing DNS cache > > > 2008-11-11 20:23:14 D [common-utils.c:215:gf_resolve_ip6] resolver: > DNS > > > cache not present, freshly probing hostname: 192.168.0.145 > > > 2008-11-11 20:23:14 D [common-utils.c:252:gf_resolve_ip6] resolver: > > > returning ip-192.168.0.145 (port-6996) for hostname: 192.168.0.145 and > > > port: 6996 > > > 2008-11-11 20:23:14 D [socket.c:183:__socket_disconnect] > gfs-remote-ds: > > > shutdown() returned -1. setting connection state to -1 > > > 2008-11-11 20:23:14 D [client-protocol.c:4153:protocol_client_cleanup] > > > gfs-remote-ds: cleaning up state in transport object 0xb7f41608 > > > ^C > > > mail ~ # > > > ---- > > > > > > > > > Does any one know what the problem is or how to fix that? > > > > > > > > > // Steve > > > -- > > > GMX Download-Spiele: Preizsturz! Alle Puzzle-Spiele Deluxe über 60% > > > billiger. > > > > > > > > > http://games.entertainment.gmx.net/de/entertainment/games/download/puzzle/index.html > > > > > > > > > _______________________________________________ > > > Gluster-devel mailing list > > > Gluster-devel@xxxxxxxxxx > > > http://lists.nongnu.org/mailman/listinfo/gluster-devel > > > > > > > > > > > -- > > hard work often pays off after time, but laziness always pays off now > > -- > GMX Download-Spiele: Preizsturz! Alle Puzzle-Spiele Deluxe über 60% > billiger. > http://games.entertainment.gmx.net/de/entertainment/games/download/puzzle/index.html > > > _______________________________________________ > Gluster-devel mailing list > Gluster-devel@xxxxxxxxxx > http://lists.nongnu.org/mailman/listinfo/gluster-devel -- Ist Ihr Browser Vista-kompatibel? Jetzt die neuesten Browser-Versionen downloaden: http://www.gmx.net/de/go/browser
