Nathan, is it possible to get a backtrace from one of the core dumps? If it is not coredumping, is it possible for you to run one of the servers withing gdb and get a bactrace when it segfaults? thanks avati 2007/8/3, Nathan Allen Stratton <nathan@xxxxxxxxxxxx>: > > On Fri, 3 Aug 2007, Anand Avati wrote: > > > Nathan, > > patch-414 should fix these issues. I think the patch covers all possible > > cases which hits this bug. Please upgrade to it. > > Also crashes with 414: > > (vs0) > > --------- > got signal (11), printing backtrace > --------- > 2007-08-02 14:56:39 E [server-protocol.c:197:generic_reply] server: > transport_writev failed > /lib64/libc.so.6[0x3f604300c0] > 2007-08-02 14:56:39 E [server-protocol.c:197:generic_reply] server: > transport_writev failed > /usr/local/lib/glusterfs/1.3.0/xlator/protocol/server.so[0x2aaaabb328a4] > 2007-08-02 14:56:39 E [server-protocol.c:197:generic_reply] server: > transport_writev failed > /usr/local/lib/glusterfs/1.3.0/xlator/protocol/server.so[0x2aaaabb32d63] > /usr/local/lib/glusterfs/1.3.0/xlator/performance/io-threads.so > [0x2aaaab92bfd5] > 2007-08-02 14:56:39 E [server-protocol.c:197:generic_reply] server: > transport_writev failed > > /usr/local/lib/glusterfs/1.3.0/xlator/cluster/unify.so(unify_writev_cbk+0x19)[0x2aaaab71e3b9] > /usr/local/lib/glusterfs/1.3.0/xlator/cluster/afr.so[0x2aaaab50de59] > /usr/local/lib/glusterfs/1.3.0/xlator/protocol/client.so[0x2aaaab305b27] > 2007-08-02 14:56:39 E [server-protocol.c:197:generic_reply] server: > transport_writev failed > /usr/local/lib/glusterfs/1.3.0/xlator/cluster/afr.so[0x2aaaab5100c8] > 2007-08-02 14:56:39 E [server-protocol.c:197:generic_reply] server: > transport_writev failed > > /usr/local/lib/glusterfs/1.3.0/xlator/cluster/unify.so(unify_writev+0xf7)[0x2aaaab722097] > 2007-08-02 14:56:39 E [server-protocol.c:197:generic_reply] server: > transport_writev failed > /usr/local/lib/glusterfs/1.3.0/xlator/performance/io-threads.so > [0x2aaaab92c873] > 2007-08-02 14:56:39 E [server-protocol.c:197:generic_reply] server: > transport_writev failed > /usr/local/lib/libglusterfs.so.0[0x2aaaaaad7e24] > 2007-08-02 14:56:39 E [server-protocol.c:197:generic_reply] server: > transport_writev failed > /usr/local/lib/libglusterfs.so.0(call_resume+0x6a)[0x2aaaaaad829a] > 2007-08-02 14:56:39 E [server-protocol.c:197:generic_reply] server: > transport_writev failed > /usr/local/lib/glusterfs/1.3.0/xlator/performance/io-threads.so > [0x2aaaab92dded] > 2007-08-02 14:56:39 D [tcp-client.c:70:tcp_connect] mirror-a-ds: socket fd > = 3 > /lib64/libpthread.so.0[0x3f610062f7] > 2007-08-02 14:56:39 E [server-protocol.c:197:generic_reply] server: > transport_writev failed > 2007-08-02 14:56:39 D [tcp-client.c:88:tcp_connect] mirror-a-ds: finalized > on port `1023' > /lib64/libc.so.6(clone+0x6d)[0x3f604ce86d] > 2007-08-02 14:56:39 D [tcp-client.c:109:tcp_connect] mirror-a-ds: > defaulting remote-port to 6996 > --------- > 2007-08-02 14:56:39 E [server-protocol.c:197:generic_reply] server: > transport_writev failed > > > (vs1) > > 2007-08-02 14:56:43 D [tcp-client.c:142:tcp_connect] mirror-c-ds: connect > on 7 in progress (non-blocking) > > --------- > got signal (11), printing backtrace > --------- > /lib64/libc.so.6[0x3f604300c0] > /usr/local/lib/glusterfs/1.3.0/xlator/protocol/server.so[0x2aaaabb328a4] > /usr/local/lib/glusterfs/1.3.0/xlator/protocol/server.so[0x2aaaabb32d63] > /usr/local/lib/glusterfs/1.3.0/xlator/performance/io-threads.so > [0x2aaaab92bfd5] > > /usr/local/lib/glusterfs/1.3.0/xlator/cluster/unify.so(unify_writev_cbk+0x19)[0x2aaaab71e3b9] > /usr/local/lib/glusterfs/1.3.0/xlator/cluster/afr.so[0x2aaaab50de59] > /usr/local/lib/glusterfs/1.3.0/xlator/protocol/client.so[0x2aaaab305b27] > /usr/local/lib/glusterfs/1.3.0/xlator/cluster/afr.so[0x2aaaab5100c8] > > /usr/local/lib/glusterfs/1.3.0/xlator/cluster/unify.so(unify_writev+0xf7)[0x2aaaab722097] > /usr/local/lib/glusterfs/1.3.0/xlator/performance/io-threads.so > [0x2aaaab92c873] > /usr/local/lib/libglusterfs.so.0[0x2aaaaaad7e24] > /usr/local/lib/libglusterfs.so.0(call_resume+0x6a)[0x2aaaaaad829a] > /usr/local/lib/glusterfs/1.3.0/xlator/performance/io-threads.so > [0x2aaaab92dded] > /lib64/libpthread.so.0[0x3f610062f7] > /lib64/libc.so.6(clone+0x6d)[0x3f604ce86d] > --------- > > > (vs2) > 2007-08-02 14:56:42 E [server-protocol.c:197:generic_reply] server: > transport_writev failed > > --------- > got signal (11), printing backtrace > --------- > 2007-08-02 14:56:42 W [client-protocol.c:4279:client_protocol_cleanup] > brick-b-ds: forced unwinding frame type(0) op(13) > 2007-08-02 14:56:42 E [afr.c:1757:afr_readv_cbk] block-b-ds-afr: > (path=/vs2_video1_13_2007-08-02.rs child=brick-b-ds) op_ret=-1 > op_errno=107 > /lib64/libc.so.6[0x3f604300c0] > 2007-08-02 14:56:42 E [tcp.c:118:tcp_except] server: shutdown () - error: > Transport endpoint is not connected > /usr/local/lib/glusterfs/1.3.0/xlator/protocol/server.so[0x2aaaabb328a4] > /usr/local/lib/glusterfs/1.3.0/xlator/protocol/server.so[0x2aaaabb32d63] > 2007-08-02 14:56:42 W [client-protocol.c:4279:client_protocol_cleanup] > brick-b-ds: forced unwinding frame type(0) op(13) > /usr/local/lib/glusterfs/1.3.0/xlator/performance/io-threads.so > [0x2aaaab92bfd5] > 2007-08-02 14:56:42 E [afr.c:1757:afr_readv_cbk] block-b-ds-afr: > (path=/vs2_video1_13_2007-08-02.rs child=brick-b-ds) op_ret=-1 > op_errno=107 > > /usr/local/lib/glusterfs/1.3.0/xlator/cluster/unify.so(unify_writev_cbk+0x19)[0x2aaaab71e3b9] > 2007-08-02 14:56:42 E [server-protocol.c:197:generic_reply] server: > transport_writev failed > /usr/local/lib/glusterfs/1.3.0/xlator/cluster/afr.so[0x2aaaab50de59] > /usr/local/lib/glusterfs/1.3.0/xlator/protocol/client.so[0x2aaaab305b27] > /usr/local/lib/glusterfs/1.3.0/xlator/cluster/afr.so[0x2aaaab5100c8] > 2007-08-02 14:56:42 W [client-protocol.c:4279:client_protocol_cleanup] > brick-b-ds: forced unwinding frame type(0) op(13) > > /usr/local/lib/glusterfs/1.3.0/xlator/cluster/unify.so(unify_writev+0xf7)[0x2aaaab722097] > /usr/local/lib/glusterfs/1.3.0/xlator/performance/io-threads.so > [0x2aaaab92c873] > 2007-08-02 14:56:42 E [afr.c:1757:afr_readv_cbk] block-b-ds-afr: > (path=/vs2_video1_13_2007-08-02.rs child=brick-b-ds) op_ret=-1 > op_errno=107 > /usr/local/lib/libglusterfs.so.0[0x2aaaaaad7e24] > 2007-08-02 14:56:42 E [tcp.c:118:tcp_except] server: shutdown () - error: > Transport endpoint is not connected > /usr/local/lib/libglusterfs.so.0(call_resume+0x6a)[0x2aaaaaad829a] > /usr/local/lib/glusterfs/1.3.0/xlator/performance/io-threads.so > [0x2aaaab92dded] > 2007-08-02 14:56:42 W [client-protocol.c:4279:client_protocol_cleanup] > brick-b-ds: forced unwinding frame type(0) op(13) > /lib64/libpthread.so.0[0x3f610062f7] > 2007-08-02 14:56:42 E [afr.c:1757:afr_readv_cbk] block-b-ds-afr: > (path=/vs2_video1_13_2007-08-02.rs child=brick-b-ds) op_ret=-1 > op_errno=107 > 2007-08-02 14:56:42 E [server-protocol.c:197:generic_reply] server: > transport_writev failed > /lib64/libc.so.6(clone+0x6d)[0x3f604ce86d] > --------- > 2007-08-02 14:56:42 W [client-protocol.c:4279:client_protocol_cleanup] > brick-b-ds: forced unwinding frame type(0) op(13) > 2007-08-02 14:56:42 E [tcp.c:118:tcp_except] server: shutdown () - error: > Transport endpoint is not connected > -- Anand V. Avati
