Teo,
If you are using glusterfs--mainline--2.4, please add to the write-behind
'option flush-behind off' and if needed 'option transport-timeout <secs>' to
protocol/client volumes (where <secs> is sufficiently large enough). the
optoin flush-behind should most likely fix your error.
Instead you could just tla update to the latest patch (patch-184) and the
errors should disappear.
thanks,
avati
2007/6/25, Constantin Teodorescu <teo@xxxxxxx>:
Anand Avati wrote:
> Teo,
> can you please send the logs from glusterfs? I'm somehow suspicious that
> traces of the old installation have been left behind in your system.
> probably manually deleting the old files (rm -rf
> ${prefix}/{lib,sbin}/glusterfs*) and try with another make install. Also
> please send the logs of both client and server running with -LDEBUG.
>
> thanks!
> avati
I have cleared all the binaries and libraries from previous install.
Double checked-it with updatedb and "locate glus". Only client.vol
configuration file waws kept.
Made a fully fresh install, no problem.
Activated writebehind again, started from scratch, at first attempt to
vacuum the database, error.
Logs from server:
[2:26:41] [ERROR/common-utils.c:55/full_rw()] libglusterfs:full_rw: 0
bytes r/w instead of 113 (errno=2)
[2:26:41] [DEBUG/protocol.c:244/gf_block_unserialize_transport()]
libglusterfs/protocol:gf_block_unserialize_transport: full_read of
header failed
[2:26:41] [DEBUG/proto-srv.c:2867/proto_srv_cleanup()]
protocol/server:cleaned up xl_private of 0x804b1d0
[2:26:41] [CRITICAL/tcp.c:81/tcp_disconnect()] transport/tcp:server:
connection to server disconnected
[2:26:41] [DEBUG/tcp-server.c:229/gf_transport_fini()]
tcp/server:destroying transport object for 89.41.136.2:1018 (fd=5)
[2:31:50] [DEBUG/tcp-server.c:134/tcp_server_notify()]
tcp/server:Registering socket (5) for new transport object of 89.41.136.2
[2:31:51] [DEBUG/proto-srv.c:2417/mop_setvolume()]
server-protocol:mop_setvolume: received port = 1021
[2:31:51] [DEBUG/proto-srv.c:2433/mop_setvolume()]
server-protocol:mop_setvolume: IP addr = 89.41.136.2, received ip addr =
89.41.136.2
[2:31:51] [DEBUG/proto-srv.c:2443/mop_setvolume()]
server-protocol:mop_setvolume: accepted client from 89.41.136.2
[2:34:27] [ERROR/common-utils.c:110/full_rwv()] libglusterfs:full_rwv:
87367 bytes r/w instead of 131281 (Connection reset by peer)
[2:34:27] [ERROR/proto-srv.c:117/generic_reply()]
protocol/server:transport_writev failed
[2:34:27] [ERROR/tcp.c:110/tcp_except()] transport/tcp:shutdown () -
error: Transport endpoint is not connected
[2:34:27] [ERROR/common-utils.c:110/full_rwv()] libglusterfs:full_rwv: 0
bytes r/w instead of 131283 (Broken pipe)
[2:34:27] [ERROR/proto-srv.c:117/generic_reply()]
protocol/server:transport_writev failed
[2:34:27] [ERROR/tcp.c:110/tcp_except()] transport/tcp:shutdown () -
error: Transport endpoint is not connected
[2:34:27] [DEBUG/proto-srv.c:2826/open_file_cleanup_fn()]
protocol/server:force releaseing file 0x80928c0
[2:34:27] [DEBUG/proto-srv.c:2826/open_file_cleanup_fn()]
protocol/server:force releaseing file 0x8051ca0
[2:34:27] [DEBUG/proto-srv.c:2867/proto_srv_cleanup()]
protocol/server:cleaned up xl_private of 0x804b1d0
[2:34:27] [CRITICAL/tcp.c:81/tcp_disconnect()] transport/tcp:server:
connection to server disconnected
[2:34:27] [DEBUG/tcp-server.c:229/gf_transport_fini()]
tcp/server:destroying transport object for 89.41.136.2:1021 (fd=5)
-------------------------------------------------------------
Logs from the client:
[2:28:52] [DEBUG/glusterfs.c:106/get_spec_fp()] glusterfs:loading spec
from /etc/glusterfs/client.vol
[2:28:52] [DEBUG/spec.y:116/new_section()]
libglusterfs/parser:new_section: New node for 'client1'
[2:28:52] [DEBUG/spec.y:132/section_type()]
libglusterfs/parser:section_type: Type:client1:protocol/client
[2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
libglusterfs/xlator:xlator_set_type: attempt to load type protocol/client
[2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
xlator_set_type: attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/xlator/protocol/client.so
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option:
Option:client1:transport-type:tcp/client
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client1:remote-host:89.41.136.4
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client1:remote-port:6996
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client1:remote-subvolume:brick
[2:28:52] [DEBUG/spec.y:209/section_end()]
libglusterfs/parser:section_end: end:client1
[2:28:52] [DEBUG/spec.y:116/new_section()]
libglusterfs/parser:new_section: New node for 'client2'
[2:28:52] [DEBUG/spec.y:132/section_type()]
libglusterfs/parser:section_type: Type:client2:protocol/client
[2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
libglusterfs/xlator:xlator_set_type: attempt to load type protocol/client
[2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
xlator_set_type: attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/xlator/protocol/client.so
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option:
Option:client2:transport-type:tcp/client
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client2:remote-host:89.41.136.5
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client2:remote-port:6996
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client2:remote-subvolume:brick
[2:28:52] [DEBUG/spec.y:209/section_end()]
libglusterfs/parser:section_end: end:client2
[2:28:52] [DEBUG/spec.y:116/new_section()]
libglusterfs/parser:new_section: New node for 'client3'
[2:28:52] [DEBUG/spec.y:132/section_type()]
libglusterfs/parser:section_type: Type:client3:protocol/client
[2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
libglusterfs/xlator:xlator_set_type: attempt to load type protocol/client
[2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
xlator_set_type: attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/xlator/protocol/client.so
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option:
Option:client3:transport-type:tcp/client
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client3:remote-host:89.41.136.6
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client3:remote-port:6996
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client3:remote-subvolume:brick
[2:28:52] [DEBUG/spec.y:209/section_end()]
libglusterfs/parser:section_end: end:client3
[2:28:52] [DEBUG/spec.y:116/new_section()]
libglusterfs/parser:new_section: New node for 'afr'
[2:28:52] [DEBUG/spec.y:132/section_type()]
libglusterfs/parser:section_type: Type:afr:cluster/afr
[2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
libglusterfs/xlator:xlator_set_type: attempt to load type cluster/afr
[2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
xlator_set_type: attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/xlator/cluster/afr.so
[2:28:52] [DEBUG/spec.y:194/section_sub()]
liglusterfs/parser:section_sub: child:afr->client1
[2:28:52] [DEBUG/spec.y:194/section_sub()]
liglusterfs/parser:section_sub: child:afr->client2
[2:28:52] [DEBUG/spec.y:194/section_sub()]
liglusterfs/parser:section_sub: child:afr->client3
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:afr:replicate:*:3
[2:28:52] [DEBUG/spec.y:209/section_end()]
libglusterfs/parser:section_end: end:afr
[2:28:52] [DEBUG/spec.y:116/new_section()]
libglusterfs/parser:new_section: New node for 'writebehind'
[2:28:52] [DEBUG/spec.y:132/section_type()]
libglusterfs/parser:section_type:
Type:writebehind:performance/write-behind
[2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
libglusterfs/xlator:xlator_set_type: attempt to load type
performance/write-behind
[2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
xlator_set_type: attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/xlator/performance/write-behind.so
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option:
Option:writebehind:aggregate-size:131072
[2:28:52] [DEBUG/spec.y:194/section_sub()]
liglusterfs/parser:section_sub: child:writebehind->afr
[2:28:52] [DEBUG/spec.y:209/section_end()]
libglusterfs/parser:section_end: end:writebehind
[2:28:52] [DEBUG/spec.y:116/new_section()]
libglusterfs/parser:new_section: New node for 'readahead'
[2:28:52] [DEBUG/spec.y:132/section_type()]
libglusterfs/parser:section_type: Type:readahead:performance/read-ahead
[2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
libglusterfs/xlator:xlator_set_type: attempt to load type
performance/read-ahead
[2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
xlator_set_type: attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/xlator/performance/read-ahead.so
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:readahead:page-size:131072
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:readahead:page-count:16
[2:28:52] [DEBUG/spec.y:194/section_sub()]
liglusterfs/parser:section_sub: child:readahead->writebehind
[2:28:52] [DEBUG/spec.y:209/section_end()]
libglusterfs/parser:section_end: end:readahead
[2:28:52] [DEBUG/read-ahead.c:533/init()] read-ahead:Using
conf->page_size = 0x20000
[2:28:52] [DEBUG/read-ahead.c:542/init()] read-ahead:Using
conf->page_count = 0x10
[2:28:52] [DEBUG/write-behind.c:520/init()] write-behind:using
aggregate-size = 131072
[2:28:52] [DEBUG/afr.c:2225/init()] afr:xlator name is client1
[2:28:52] [DEBUG/afr.c:2225/init()] afr:xlator name is client2
[2:28:52] [DEBUG/afr.c:2225/init()] afr:xlator name is client3
[2:28:52] [DEBUG/afr.c:2229/init()] afr:child count 3
[2:28:52] [DEBUG/afr.c:2246/init()] afr:afr->init: lock node not
specified, defaulting to client1
[2:28:52] [DEBUG/client-protocol.c:2801/init()]
protocol/client:defaulting transport-timeout to 120
[2:28:52] [DEBUG/transport.c:83/transport_load()]
libglusterfs/transport:attempt to load type tcp/client
[2:28:52] [DEBUG/transport.c:88/transport_load()]
libglusterfs/transport:attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/transport/tcp/client.so
[2:28:52] [DEBUG/tcp-client.c:180/tcp_connect()] transport: tcp:
:try_connect: socket fd = 7
[2:28:52] [DEBUG/tcp-client.c:202/tcp_connect()] transport: tcp:
:try_connect: finalized on port `1023'
[2:28:52] [DEBUG/tcp-client.c:262/tcp_connect()] tcp/client:connect on 7
in progress (non-blocking)
[2:28:52] [DEBUG/tcp-client.c:301/tcp_connect()] tcp/client:connection
on 7 still in progress - try later
[2:28:52] [DEBUG/client-protocol.c:2801/init()]
protocol/client:defaulting transport-timeout to 120
[2:28:52] [DEBUG/transport.c:83/transport_load()]
libglusterfs/transport:attempt to load type tcp/client
[2:28:52] [DEBUG/transport.c:88/transport_load()]
libglusterfs/transport:attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/transport/tcp/client.so
[2:28:52] [DEBUG/tcp-client.c:180/tcp_connect()] transport: tcp:
:try_connect: socket fd = 8
[2:28:52] [DEBUG/tcp-client.c:202/tcp_connect()] transport: tcp:
:try_connect: finalized on port `1022'
[2:28:52] [DEBUG/tcp-client.c:262/tcp_connect()] tcp/client:connect on 8
in progress (non-blocking)
[2:28:52] [DEBUG/tcp-client.c:301/tcp_connect()] tcp/client:connection
on 8 still in progress - try later
[2:28:52] [DEBUG/client-protocol.c:2801/init()]
protocol/client:defaulting transport-timeout to 120
[2:28:52] [DEBUG/transport.c:83/transport_load()]
libglusterfs/transport:attempt to load type tcp/client
[2:28:52] [DEBUG/transport.c:88/transport_load()]
libglusterfs/transport:attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/transport/tcp/client.so
[2:28:52] [DEBUG/tcp-client.c:180/tcp_connect()] transport: tcp:
:try_connect: socket fd = 9
[2:28:52] [DEBUG/tcp-client.c:202/tcp_connect()] transport: tcp:
:try_connect: finalized on port `1021'
[2:28:52] [DEBUG/tcp-client.c:262/tcp_connect()] tcp/client:connect on 9
in progress (non-blocking)
[2:28:52] [DEBUG/tcp-client.c:301/tcp_connect()] tcp/client:connection
on 9 still in progress - try later
[2:28:53] [DEBUG/tcp-client.c:310/tcp_connect()] tcp/client:connection
on 9 success, attempting to handshake
[2:28:53] [DEBUG/tcp-client.c:54/do_handshake()]
transport/tcp-client:dictionary length = 50
[2:28:53] [DEBUG/tcp-client.c:310/tcp_connect()] tcp/client:connection
on 8 success, attempting to handshake
[2:28:53] [DEBUG/tcp-client.c:54/do_handshake()]
transport/tcp-client:dictionary length = 50
[2:28:53] [DEBUG/tcp-client.c:310/tcp_connect()] tcp/client:connection
on 7 success, attempting to handshake
[2:28:53] [DEBUG/tcp-client.c:54/do_handshake()]
transport/tcp-client:dictionary length = 50
[2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
*, filename = PG_VERSION,
[2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
*, filename = 533216695,
[2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
*, filename = 533216698,
[2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
*, filename = 533216700,
[2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
*, filename = 533216703,
[2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
*, filename = 533216707,
[2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
*, filename = 533216709,
[root@bnd-centos glusterfs]# cat /var/log/glusterfsd.log
[2:28:52] [DEBUG/glusterfs.c:106/get_spec_fp()] glusterfs:loading spec
from /etc/glusterfs/client.vol
[2:28:52] [DEBUG/spec.y:116/new_section()]
libglusterfs/parser:new_section: New node for 'client1'
[2:28:52] [DEBUG/spec.y:132/section_type()]
libglusterfs/parser:section_type: Type:client1:protocol/client
[2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
libglusterfs/xlator:xlator_set_type: attempt to load type protocol/client
[2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
xlator_set_type: attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/xlator/protocol/client.so
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option:
Option:client1:transport-type:tcp/client
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client1:remote-host:89.41.136.4
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client1:remote-port:6996
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client1:remote-subvolume:brick
[2:28:52] [DEBUG/spec.y:209/section_end()]
libglusterfs/parser:section_end: end:client1
[2:28:52] [DEBUG/spec.y:116/new_section()]
libglusterfs/parser:new_section: New node for 'client2'
[2:28:52] [DEBUG/spec.y:132/section_type()]
libglusterfs/parser:section_type: Type:client2:protocol/client
[2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
libglusterfs/xlator:xlator_set_type: attempt to load type protocol/client
[2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
xlator_set_type: attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/xlator/protocol/client.so
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option:
Option:client2:transport-type:tcp/client
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client2:remote-host:89.41.136.5
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client2:remote-port:6996
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client2:remote-subvolume:brick
[2:28:52] [DEBUG/spec.y:209/section_end()]
libglusterfs/parser:section_end: end:client2
[2:28:52] [DEBUG/spec.y:116/new_section()]
libglusterfs/parser:new_section: New node for 'client3'
[2:28:52] [DEBUG/spec.y:132/section_type()]
libglusterfs/parser:section_type: Type:client3:protocol/client
[2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
libglusterfs/xlator:xlator_set_type: attempt to load type protocol/client
[2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
xlator_set_type: attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/xlator/protocol/client.so
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option:
Option:client3:transport-type:tcp/client
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client3:remote-host:89.41.136.6
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client3:remote-port:6996
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:client3:remote-subvolume:brick
[2:28:52] [DEBUG/spec.y:209/section_end()]
libglusterfs/parser:section_end: end:client3
[2:28:52] [DEBUG/spec.y:116/new_section()]
libglusterfs/parser:new_section: New node for 'afr'
[2:28:52] [DEBUG/spec.y:132/section_type()]
libglusterfs/parser:section_type: Type:afr:cluster/afr
[2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
libglusterfs/xlator:xlator_set_type: attempt to load type cluster/afr
[2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
xlator_set_type: attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/xlator/cluster/afr.so
[2:28:52] [DEBUG/spec.y:194/section_sub()]
liglusterfs/parser:section_sub: child:afr->client1
[2:28:52] [DEBUG/spec.y:194/section_sub()]
liglusterfs/parser:section_sub: child:afr->client2
[2:28:52] [DEBUG/spec.y:194/section_sub()]
liglusterfs/parser:section_sub: child:afr->client3
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:afr:replicate:*:3
[2:28:52] [DEBUG/spec.y:209/section_end()]
libglusterfs/parser:section_end: end:afr
[2:28:52] [DEBUG/spec.y:116/new_section()]
libglusterfs/parser:new_section: New node for 'writebehind'
[2:28:52] [DEBUG/spec.y:132/section_type()]
libglusterfs/parser:section_type:
Type:writebehind:performance/write-behind
[2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
libglusterfs/xlator:xlator_set_type: attempt to load type
performance/write-behind
[2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
xlator_set_type: attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/xlator/performance/write-behind.so
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option:
Option:writebehind:aggregate-size:131072
[2:28:52] [DEBUG/spec.y:194/section_sub()]
liglusterfs/parser:section_sub: child:writebehind->afr
[2:28:52] [DEBUG/spec.y:209/section_end()]
libglusterfs/parser:section_end: end:writebehind
[2:28:52] [DEBUG/spec.y:116/new_section()]
libglusterfs/parser:new_section: New node for 'readahead'
[2:28:52] [DEBUG/spec.y:132/section_type()]
libglusterfs/parser:section_type: Type:readahead:performance/read-ahead
[2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
libglusterfs/xlator:xlator_set_type: attempt to load type
performance/read-ahead
[2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
xlator_set_type: attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/xlator/performance/read-ahead.so
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:readahead:page-size:131072
[2:28:52] [DEBUG/spec.y:152/section_option()]
libglusterfs/parser:section_option: Option:readahead:page-count:16
[2:28:52] [DEBUG/spec.y:194/section_sub()]
liglusterfs/parser:section_sub: child:readahead->writebehind
[2:28:52] [DEBUG/spec.y:209/section_end()]
libglusterfs/parser:section_end: end:readahead
[2:28:52] [DEBUG/read-ahead.c:533/init()] read-ahead:Using
conf->page_size = 0x20000
[2:28:52] [DEBUG/read-ahead.c:542/init()] read-ahead:Using
conf->page_count = 0x10
[2:28:52] [DEBUG/write-behind.c:520/init()] write-behind:using
aggregate-size = 131072
[2:28:52] [DEBUG/afr.c:2225/init()] afr:xlator name is client1
[2:28:52] [DEBUG/afr.c:2225/init()] afr:xlator name is client2
[2:28:52] [DEBUG/afr.c:2225/init()] afr:xlator name is client3
[2:28:52] [DEBUG/afr.c:2229/init()] afr:child count 3
[2:28:52] [DEBUG/afr.c:2246/init()] afr:afr->init: lock node not
specified, defaulting to client1
[2:28:52] [DEBUG/client-protocol.c:2801/init()]
protocol/client:defaulting transport-timeout to 120
[2:28:52] [DEBUG/transport.c:83/transport_load()]
libglusterfs/transport:attempt to load type tcp/client
[2:28:52] [DEBUG/transport.c:88/transport_load()]
libglusterfs/transport:attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/transport/tcp/client.so
[2:28:52] [DEBUG/tcp-client.c:180/tcp_connect()] transport: tcp:
:try_connect: socket fd = 7
[2:28:52] [DEBUG/tcp-client.c:202/tcp_connect()] transport: tcp:
:try_connect: finalized on port `1023'
[2:28:52] [DEBUG/tcp-client.c:262/tcp_connect()] tcp/client:connect on 7
in progress (non-blocking)
[2:28:52] [DEBUG/tcp-client.c:301/tcp_connect()] tcp/client:connection
on 7 still in progress - try later
[2:28:52] [DEBUG/client-protocol.c:2801/init()]
protocol/client:defaulting transport-timeout to 120
[2:28:52] [DEBUG/transport.c:83/transport_load()]
libglusterfs/transport:attempt to load type tcp/client
[2:28:52] [DEBUG/transport.c:88/transport_load()]
libglusterfs/transport:attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/transport/tcp/client.so
[2:28:52] [DEBUG/tcp-client.c:180/tcp_connect()] transport: tcp:
:try_connect: socket fd = 8
[2:28:52] [DEBUG/tcp-client.c:202/tcp_connect()] transport: tcp:
:try_connect: finalized on port `1022'
[2:28:52] [DEBUG/tcp-client.c:262/tcp_connect()] tcp/client:connect on 8
in progress (non-blocking)
[2:28:52] [DEBUG/tcp-client.c:301/tcp_connect()] tcp/client:connection
on 8 still in progress - try later
[2:28:52] [DEBUG/client-protocol.c:2801/init()]
protocol/client:defaulting transport-timeout to 120
[2:28:52] [DEBUG/transport.c:83/transport_load()]
libglusterfs/transport:attempt to load type tcp/client
[2:28:52] [DEBUG/transport.c:88/transport_load()]
libglusterfs/transport:attempt to load file
/usr/lib/glusterfs/1.3.0-pre3/transport/tcp/client.so
[2:28:52] [DEBUG/tcp-client.c:180/tcp_connect()] transport: tcp:
:try_connect: socket fd = 9
[2:28:52] [DEBUG/tcp-client.c:202/tcp_connect()] transport: tcp:
:try_connect: finalized on port `1021'
[2:28:52] [DEBUG/tcp-client.c:262/tcp_connect()] tcp/client:connect on 9
in progress (non-blocking)
[2:28:52] [DEBUG/tcp-client.c:301/tcp_connect()] tcp/client:connection
on 9 still in progress - try later
[2:28:53] [DEBUG/tcp-client.c:310/tcp_connect()] tcp/client:connection
on 9 success, attempting to handshake
[2:28:53] [DEBUG/tcp-client.c:54/do_handshake()]
transport/tcp-client:dictionary length = 50
[2:28:53] [DEBUG/tcp-client.c:310/tcp_connect()] tcp/client:connection
on 8 success, attempting to handshake
[2:28:53] [DEBUG/tcp-client.c:54/do_handshake()]
transport/tcp-client:dictionary length = 50
[2:28:53] [DEBUG/tcp-client.c:310/tcp_connect()] tcp/client:connection
on 7 success, attempting to handshake
[2:28:53] [DEBUG/tcp-client.c:54/do_handshake()]
transport/tcp-client:dictionary length = 50
[2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
*, filename = PG_VERSION,
[2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
*, filename = 533216695,
[2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
*, filename = 533216698,
[2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
*, filename = 533216700,
[2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
*, filename = 533216703,
[2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
*, filename = 533216707,
[2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
*, filename = 533216709,
[2:31:29] [CRITICAL/client-protocol.c:218/call_bail()]
client/protocol:bailing transport
[2:31:29] [DEBUG/tcp.c:123/cont_hand()] tcp:forcing poll/read/write to
break on blocked socket (if any)
[2:31:29] [CRITICAL/client-protocol.c:218/call_bail()]
client/protocol:bailing transport
[2:31:29] [ERROR/common-utils.c:110/full_rwv()] libglusterfs:full_rwv:
6542 bytes r/w instead of 131420 (Broken pipe)
[2:31:29] [ERROR/client-protocol.c:204/client_protocol_xfer()]
protocol/client:transport_submit failed
[2:31:29] [DEBUG/tcp.c:123/cont_hand()] tcp:forcing poll/read/write to
break on blocked socket (if any)
[2:31:29] [CRITICAL/client-protocol.c:218/call_bail()]
client/protocol:bailing transport
[2:31:29] [DEBUG/client-protocol.c:2609/client_protocol_cleanup()]
protocol/client:cleaning up state in transport object 0x2428730
[2:31:29] [DEBUG/tcp.c:123/cont_hand()] tcp:forcing poll/read/write to
break on blocked socket (if any)
[2:31:29] [CRITICAL/client-protocol.c:218/call_bail()]
client/protocol:bailing transport
[2:31:29] [DEBUG/tcp.c:123/cont_hand()] tcp:forcing poll/read/write to
break on blocked socket (if any)
[2:31:29] [CRITICAL/client-protocol.c:218/call_bail()]
client/protocol:bailing transport
[2:31:29] [DEBUG/tcp.c:123/cont_hand()] tcp:forcing poll/read/write to
break on blocked socket (if any)
...............
...............
[2:31:29] [CRITICAL/client-protocol.c:218/call_bail()]
client/protocol:bailing transport
[2:31:29] [DEBUG/tcp.c:123/cont_hand()] tcp:forcing poll/read/write to
break on blocked socket (if any)
[2:31:29] [CRITICAL/client-protocol.c:218/call_bail()]
client/protocol:bailing transport
[2:31:29] [DEBUG/tcp.c:123/cont_hand()] tcp:forcing poll/read/write to
break on blocked socket (if any)
[2:31:29] [CRITICAL/client-protocol.c:218/call_bail()]
client/protocol:bailing transport
[2:31:29] [DEBUG/tcp.c:123/cont_hand()] tcp:forcing poll/read/write to
break on blocked socket (if any)
[2:31:29] [DEBUG/client-protocol.c:2712/client_protocol_interpret()]
protocol/client:frame not found for blk with callid: 11249
[2:31:29] [DEBUG/client-protocol.c:2609/client_protocol_cleanup()]
protocol/client:cleaning up state in transport object 0x2428730
[2:31:29] [CRITICAL/tcp.c:81/tcp_disconnect()] transport/tcp:client1:
connection to server disconnected
--
Anand V. Avati
