Hello Vijay,
Thank you for your replay. I'm sending you requested files, please
correct me if there is a missing one :) /debian logs its services in
debianish way, so I may be missing something:)/
(o) glusterd log from brick 0:
location: /var/log/glusterfs/bricks
name: g0.log
(o) native client mount log
name: gluster.log
I'll definitely try v3.3.0 release of glusterfs with same test
configuration. Which version I should try (i.e. which one is more recent):
(o)
http://bits.gluster.com/pub/gluster/glusterfs/src/glusterfs-3.3.0qa37.tar.gz
Or the beta version, found @ official glusterfs web page, namely:
(o)
http://download.gluster.org/pub/gluster/glusterfs/qa-releases/3.3.0beta3/glusterfs-3.3.0beta3.tar.gz
Regards,
Hristo Hristov
On 4/21/12 4:18 PM, Vijay Bellur wrote:
On 04/20/2012 10:47 AM, Hristo Hristov wrote:
Dear list,
I'm testing a little GlusterFS setup on debian wheezy:
=== snip ===
muzzy:~# cat /etc/debian_version
wheezy/sid
muzzy:~# dpkg -l | grep gluster
ii glusterfs-client 3.2.6-1 clustered file-system (client package)
ii glusterfs-common 3.2.6-1 GlusterFS common libraries and translator
modules
ii glusterfs-server 3.2.6-1 clustered file-system (server package)
=== snip ===
One of nodes, (g0), also mounts m3d volume (mount -t glusterfs) and
"exports" it via samba and webdav. I'm using two different
directories under volume root for each of them, i.e. dav and cifs.
/This is not the best way to do export the volume, but I do not have
more nodes at the moment :(/
I'm mounting the volume with the following parameters:
=== snip ===
mount -t glusterfs g0:/m3d /mnt/m3d -o
acl,log-level=WARNING,log-file=/var/log/gluster.log
=== snip ===
Can you please provide the glusterd log file from g0 and the client
(mount) log file?
Additionally, it would be great if you can confirm similar behavior
with a newer 3.3.0 qa release.
Thanks,
Vijay
[2012-04-18 09:58:31.990257] I [glusterfsd.c:1493:main] 0-/usr/sbin/glusterfsd: Started running /usr/sbin/glusterfsd version 3.2.6
[2012-04-18 09:58:31.994639] W [socket.c:419:__socket_keepalive] 0-socket: failed to set keep idle on socket 8
[2012-04-18 09:58:31.994692] W [socket.c:1846:socket_server_event_handler] 0-socket.glusterfsd: Failed to set keep-alive: Operation not supported
[2012-04-18 09:58:32.16368] W [graph.c:291:gf_add_cmdline_options] 0-tv01-server: adding option 'listen-port' for volume 'tv01-server' with value '24009'
[2012-04-18 09:58:32.17281] W [rpc-transport.c:447:validate_volume_options] 0-tcp.tv01-server: option 'listen-port' is deprecated, preferred is 'transport.socket.listen-port', continuing with correction
Given volfile:
+------------------------------------------------------------------------------+
1: volume tv01-posix
2: type storage/posix
3: option directory /g0
4: end-volume
5:
6: volume tv01-access-control
7: type features/access-control
8: subvolumes tv01-posix
9: end-volume
10:
11: volume tv01-locks
12: type features/locks
13: subvolumes tv01-access-control
14: end-volume
15:
16: volume tv01-io-threads
17: type performance/io-threads
18: subvolumes tv01-locks
19: end-volume
20:
21: volume tv01-marker
22: type features/marker
23: option volume-uuid caf18c1a-73f2-46b4-858a-82cc904b45c9
24: option timestamp-file /etc/glusterd/vols/tv01/marker.tstamp
25: option xtime off
26: option quota off
27: subvolumes tv01-io-threads
28: end-volume
29:
30: volume /g0
31: type debug/io-stats
32: option latency-measurement off
33: option count-fop-hits off
34: subvolumes tv01-marker
35: end-volume
36:
37: volume tv01-server
38: type protocol/server
39: option transport-type tcp
40: option auth.addr./g0.allow 194.*
41: subvolumes /g0
42: end-volume
+------------------------------------------------------------------------------+
[2012-04-18 09:58:35.665983] I [server-handshake.c:542:server_setvolume] 0-tv01-server: accepted client from 194.12.234.64:1022 (version: 3.2.6)
[2012-04-18 09:58:36.38620] I [server-handshake.c:542:server_setvolume] 0-tv01-server: accepted client from 194.12.234.101:1022 (version: 3.2.6)
[2012-04-18 10:01:44.660046] I [server-handshake.c:542:server_setvolume] 0-tv01-server: accepted client from 194.12.234.101:1021 (version: 3.2.6)
[2012-04-18 10:45:12.345634] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.tv01-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1021)
[2012-04-18 10:45:12.345787] I [server.c:438:server_rpc_notify] 0-tv01-server: disconnected connection from 194.12.234.101:1021
[2012-04-18 10:45:12.345810] I [server-helpers.c:783:server_connection_destroy] 0-tv01-server: destroyed connection of muzzy-28840-2012/04/18-10:01:40:650237-tv01-client-0
[2012-04-18 10:45:56.894155] I [server-handshake.c:542:server_setvolume] 0-tv01-server: accepted client from 194.12.234.101:1014 (version: 3.2.6)
[2012-04-18 11:39:10.358366] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.tv01-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1014)
[2012-04-18 11:39:10.358517] I [server.c:438:server_rpc_notify] 0-tv01-server: disconnected connection from 194.12.234.101:1014
[2012-04-18 11:39:10.358542] I [server-helpers.c:783:server_connection_destroy] 0-tv01-server: destroyed connection of muzzy-1661-2012/04/18-10:45:52:885040-tv01-client-0
[2012-04-18 11:40:01.251641] W [glusterfsd.c:727:cleanup_and_exit] (-->/usr/lib/libgfrpc.so.0(rpcsvc_notify+0x9b) [0x7f9c705a76eb] (-->/usr/lib/libgfrpc.so.0(rpcsvc_handle_rpc_call+0x29f) [0x7f9c705a713f] (-->/usr/sbin/glusterfsd(glusterfs_handle_terminate+0x1d) [0x7f9c70c47e1d]))) 0-: received signum (15), shutting down
[2012-04-18 11:40:01.252011] W [glusterfsd.c:727:cleanup_and_exit] (-->/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f9c6fcb990d] (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7f9c6ff6eb50] (-->/usr/sbin/glusterfsd(glusterfs_sigwaiter+0xd5) [0x7f9c70c47325]))) 0-: received signum (15), shutting down
[2012-04-18 11:40:01.252011] W [glusterfsd.c:727:cleanup_and_exit] (-->/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f9c6fcb990d] (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7f9c6ff6eb50] (-->/usr/sbin/glusterfsd(glusterfs_sigwaiter+0xd5) [0x7f9c70c47325]))) 0-: received signum (15), shutting down
[2012-04-18 17:20:49.65131] I [glusterfsd.c:1493:main] 0-/usr/sbin/glusterfsd: Started running /usr/sbin/glusterfsd version 3.2.6
[2012-04-18 17:20:49.69247] W [socket.c:419:__socket_keepalive] 0-socket: failed to set keep idle on socket 8
[2012-04-18 17:20:49.69291] W [socket.c:1846:socket_server_event_handler] 0-socket.glusterfsd: Failed to set keep-alive: Operation not supported
[2012-04-18 17:20:49.99797] W [graph.c:291:gf_add_cmdline_options] 0-m3-server: adding option 'listen-port' for volume 'm3-server' with value '24009'
[2012-04-18 17:20:49.101735] W [rpc-transport.c:447:validate_volume_options] 0-tcp.m3-server: option 'listen-port' is deprecated, preferred is 'transport.socket.listen-port', continuing with correction
Given volfile:
+------------------------------------------------------------------------------+
1: volume m3-posix
2: type storage/posix
3: option directory /g0
4: end-volume
5:
6: volume m3-access-control
7: type features/access-control
8: subvolumes m3-posix
9: end-volume
10:
11: volume m3-locks
12: type features/locks
13: subvolumes m3-access-control
14: end-volume
15:
16: volume m3-io-threads
17: type performance/io-threads
18: subvolumes m3-locks
19: end-volume
20:
21: volume m3-marker
22: type features/marker
23: option volume-uuid c548b8d9-fe34-43d8-bbc2-4592bb7627bd
24: option timestamp-file /etc/glusterd/vols/m3/marker.tstamp
25: option xtime off
26: option quota off
27: subvolumes m3-io-threads
28: end-volume
29:
30: volume /g0
31: type debug/io-stats
32: option latency-measurement off
33: option count-fop-hits off
34: subvolumes m3-marker
35: end-volume
36:
37: volume m3-server
38: type protocol/server
39: option transport-type tcp
40: option auth.addr./g0.allow *
41: subvolumes /g0
42: end-volume
+------------------------------------------------------------------------------+
[2012-04-18 17:20:53.127904] I [server-handshake.c:542:server_setvolume] 0-m3-server: accepted client from 194.12.234.101:1022 (version: 3.2.6)
[2012-04-18 17:20:53.490961] I [server-handshake.c:542:server_setvolume] 0-m3-server: accepted client from 194.12.234.193:1017 (version: 3.2.6)
[2012-04-18 17:20:53.865762] I [server-handshake.c:542:server_setvolume] 0-m3-server: accepted client from 194.12.234.64:1020 (version: 3.2.6)
[2012-04-18 17:22:39.383489] I [server-handshake.c:542:server_setvolume] 0-m3-server: accepted client from 194.12.234.236:1019 (version: 3.2.6)
[2012-04-18 17:28:20.576798] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.236:1019)
[2012-04-18 17:28:20.576906] I [server.c:438:server_rpc_notify] 0-m3-server: disconnected connection from 194.12.234.236:1019
[2012-04-18 17:28:20.576928] I [server-helpers.c:783:server_connection_destroy] 0-m3-server: destroyed connection of lisa-9469-2012/04/18-17:22:35:127164-m3-client-0
[2012-04-18 17:28:41.349962] W [glusterfsd.c:727:cleanup_and_exit] (-->/usr/lib/libgfrpc.so.0(rpcsvc_notify+0x9b) [0x7f9d977ed6eb] (-->/usr/lib/libgfrpc.so.0(rpcsvc_handle_rpc_call+0x29f) [0x7f9d977ed13f] (-->/usr/sbin/glusterfsd(glusterfs_handle_terminate+0x1d) [0x7f9d97e8de1d]))) 0-: received signum (15), shutting down
[2012-04-18 17:31:04.932166] I [glusterfsd.c:1493:main] 0-/usr/sbin/glusterfsd: Started running /usr/sbin/glusterfsd version 3.2.6
[2012-04-18 17:31:04.936284] W [socket.c:419:__socket_keepalive] 0-socket: failed to set keep idle on socket 8
[2012-04-18 17:31:04.936329] W [socket.c:1846:socket_server_event_handler] 0-socket.glusterfsd: Failed to set keep-alive: Operation not supported
[2012-04-18 17:31:04.960148] W [graph.c:291:gf_add_cmdline_options] 0-m3s-server: adding option 'listen-port' for volume 'm3s-server' with value '24010'
[2012-04-18 17:31:04.960773] W [rpc-transport.c:447:validate_volume_options] 0-tcp.m3s-server: option 'listen-port' is deprecated, preferred is 'transport.socket.listen-port', continuing with correction
Given volfile:
+------------------------------------------------------------------------------+
1: volume m3s-posix
2: type storage/posix
3: option directory /g0
4: end-volume
5:
6: volume m3s-access-control
7: type features/access-control
8: subvolumes m3s-posix
9: end-volume
10:
11: volume m3s-locks
12: type features/locks
13: subvolumes m3s-access-control
14: end-volume
15:
16: volume m3s-io-threads
17: type performance/io-threads
18: subvolumes m3s-locks
19: end-volume
20:
21: volume m3s-marker
22: type features/marker
23: option volume-uuid 925ea8cf-e203-422f-abdb-88a1e1057f86
24: option timestamp-file /etc/glusterd/vols/m3s/marker.tstamp
25: option xtime off
26: option quota off
27: subvolumes m3s-io-threads
28: end-volume
29:
30: volume /g0
31: type debug/io-stats
32: option latency-measurement off
33: option count-fop-hits off
34: subvolumes m3s-marker
35: end-volume
36:
37: volume m3s-server
38: type protocol/server
39: option transport-type tcp
40: option auth.addr./g0.allow *
41: subvolumes /g0
42: end-volume
+------------------------------------------------------------------------------+
[2012-04-18 17:31:08.986390] I [server-handshake.c:542:server_setvolume] 0-m3s-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-18 17:31:09.50778] I [server-handshake.c:542:server_setvolume] 0-m3s-server: accepted client from 194.12.234.193:1017 (version: 3.2.6)
[2012-04-18 17:31:09.138451] I [server-handshake.c:542:server_setvolume] 0-m3s-server: accepted client from 194.12.234.64:1023 (version: 3.2.6)
[2012-04-18 17:31:51.103314] I [server-handshake.c:542:server_setvolume] 0-m3s-server: accepted client from 194.12.234.236:1019 (version: 3.2.6)
[2012-04-18 17:51:53.675418] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3s-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.236:1019)
[2012-04-18 17:51:53.675823] I [server.c:438:server_rpc_notify] 0-m3s-server: disconnected connection from 194.12.234.236:1019
[2012-04-18 17:51:53.675850] I [server-helpers.c:783:server_connection_destroy] 0-m3s-server: destroyed connection of lisa-10321-2012/04/18-17:31:46:850337-m3s-client-0
[2012-04-18 20:27:31.655248] W [glusterfsd.c:727:cleanup_and_exit] (-->/usr/lib/libgfrpc.so.0(rpcsvc_notify+0x9b) [0x7fb1f5f0b6eb] (-->/usr/lib/libgfrpc.so.0(rpcsvc_handle_rpc_call+0x29f) [0x7fb1f5f0b13f] (-->/usr/sbin/glusterfsd(glusterfs_handle_terminate+0x1d) [0x7fb1f65abe1d]))) 0-: received signum (15), shutting down
[2012-04-18 20:31:46.255456] I [glusterfsd.c:1493:main] 0-/usr/sbin/glusterfsd: Started running /usr/sbin/glusterfsd version 3.2.6
[2012-04-18 20:31:46.259861] W [socket.c:419:__socket_keepalive] 0-socket: failed to set keep idle on socket 8
[2012-04-18 20:31:46.259911] W [socket.c:1846:socket_server_event_handler] 0-socket.glusterfsd: Failed to set keep-alive: Operation not supported
[2012-04-18 20:31:46.286892] W [graph.c:291:gf_add_cmdline_options] 0-m3d-server: adding option 'listen-port' for volume 'm3d-server' with value '24009'
[2012-04-18 20:31:46.288280] W [rpc-transport.c:447:validate_volume_options] 0-tcp.m3d-server: option 'listen-port' is deprecated, preferred is 'transport.socket.listen-port', continuing with correction
Given volfile:
+------------------------------------------------------------------------------+
1: volume m3d-posix
2: type storage/posix
3: option directory /g0
4: end-volume
5:
6: volume m3d-access-control
7: type features/access-control
8: subvolumes m3d-posix
9: end-volume
10:
11: volume m3d-locks
12: type features/locks
13: subvolumes m3d-access-control
14: end-volume
15:
16: volume m3d-io-threads
17: type performance/io-threads
18: subvolumes m3d-locks
19: end-volume
20:
21: volume m3d-marker
22: type features/marker
23: option volume-uuid 38927af0-423c-4c69-9f62-a90262d55b3c
24: option timestamp-file /etc/glusterd/vols/m3d/marker.tstamp
25: option xtime off
26: option quota off
27: subvolumes m3d-io-threads
28: end-volume
29:
30: volume /g0
31: type debug/io-stats
32: option latency-measurement off
33: option count-fop-hits off
34: subvolumes m3d-marker
35: end-volume
36:
37: volume m3d-server
38: type protocol/server
39: option transport-type tcp
40: option auth.addr./g0.allow *
41: subvolumes /g0
42: end-volume
+------------------------------------------------------------------------------+
[2012-04-18 20:31:50.313440] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-18 20:31:50.368786] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1017 (version: 3.2.6)
[2012-04-18 20:31:50.444221] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1022 (version: 3.2.6)
[2012-04-18 20:34:06.895440] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-18 20:34:06.904686] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-18 20:34:06.904805] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-18 20:34:06.904827] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-29235-2012/04/18-20:31:46:277810-m3d-client-0
[2012-04-18 20:34:07.930575] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1017)
[2012-04-18 20:34:07.930624] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1017
[2012-04-18 20:34:07.930644] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-15779-2012/04/18-20:31:47:189339-m3d-client-0
[2012-04-18 20:34:07.962340] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1022)
[2012-04-18 20:34:07.962396] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1022
[2012-04-18 20:34:07.962416] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-2431-2012/04/18-19:01:09:904275-m3d-client-0
[2012-04-18 20:34:11.942800] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1021 (version: 3.2.6)
[2012-04-18 20:34:12.991104] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1014 (version: 3.2.6)
[2012-04-18 20:34:13.60325] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1018 (version: 3.2.6)
[2012-04-18 20:34:27.436573] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-18 20:34:27.445783] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1021)
[2012-04-18 20:34:27.445878] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1021
[2012-04-18 20:34:27.445899] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-29531-2012/04/18-20:34:07:914356-m3d-client-0
[2012-04-18 20:34:28.475754] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1014)
[2012-04-18 20:34:28.475914] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1014
[2012-04-18 20:34:28.475940] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-16970-2012/04/18-20:34:09:811178-m3d-client-0
[2012-04-18 20:34:28.535182] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1018)
[2012-04-18 20:34:28.535249] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1018
[2012-04-18 20:34:28.535270] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-2440-2012/04/18-19:03:32:519594-m3d-client-0
[2012-04-18 20:34:32.488221] E [authenticate.c:227:gf_authenticate] 0-auth: no authentication module is interested in accepting remote-client (null)
[2012-04-18 20:34:32.488242] E [server-handshake.c:553:server_setvolume] 0-m3d-server: Cannot authenticate client from 194.12.234.101:1012 3.2.6
[2012-04-18 20:34:33.529775] E [authenticate.c:227:gf_authenticate] 0-auth: no authentication module is interested in accepting remote-client (null)
[2012-04-18 20:34:33.529797] E [server-handshake.c:553:server_setvolume] 0-m3d-server: Cannot authenticate client from 194.12.234.193:1008 3.2.6
[2012-04-18 20:34:33.633207] E [authenticate.c:227:gf_authenticate] 0-auth: no authentication module is interested in accepting remote-client (null)
[2012-04-18 20:34:33.633234] E [server-handshake.c:553:server_setvolume] 0-m3d-server: Cannot authenticate client from 194.12.234.64:1014 3.2.6
[2012-04-18 20:50:42.144398] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-18 20:50:42.153855] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1012)
[2012-04-18 20:50:42.153925] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1012
[2012-04-18 20:50:42.153941] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-29586-2012/04/18-20:34:28:458433-m3d-client-0
[2012-04-18 20:50:43.221419] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1008)
[2012-04-18 20:50:43.221474] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1008
[2012-04-18 20:50:43.221489] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-17127-2012/04/18-20:34:30:349043-m3d-client-0
[2012-04-18 20:50:43.226651] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1014)
[2012-04-18 20:50:43.226681] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1014
[2012-04-18 20:50:43.226695] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-2447-2012/04/18-19:03:53:91595-m3d-client-0
[2012-04-18 20:50:47.196861] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-18 20:50:48.277960] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1017 (version: 3.2.6)
[2012-04-18 20:50:48.324937] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1022 (version: 3.2.6)
[2012-04-18 20:52:23.475593] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1017 (version: 3.2.6)
[2012-04-19 09:55:32.52098] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1017)
[2012-04-19 09:55:32.52217] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1017
[2012-04-19 09:55:32.52240] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-31707-2012/04/18-20:52:19:465477-m3d-client-0
[2012-04-19 09:55:37.500880] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1010 (version: 3.2.6)
[2012-04-19 09:57:18.32967] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1010)
[2012-04-19 09:57:18.33045] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1010
[2012-04-19 09:57:18.33067] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-32478-2012/04/19-09:55:33:489888-m3d-client-0
[2012-04-19 09:57:45.839159] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1017 (version: 3.2.6)
[2012-04-19 09:57:58.88600] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1017)
[2012-04-19 09:57:58.88681] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1017
[2012-04-19 09:57:58.88702] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-458-2012/04/19-09:57:41:830603-m3d-client-0
[2012-04-19 10:08:23.461686] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1017 (version: 3.2.6)
[2012-04-19 10:25:31.184590] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1017)
[2012-04-19 10:25:31.184667] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1017
[2012-04-19 10:25:31.184689] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-1882-2012/04/19-10:08:19:453139-m3d-client-0
[2012-04-19 10:26:11.14368] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1010 (version: 3.2.6)
[2012-04-19 11:03:27.240861] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1010)
[2012-04-19 11:03:27.240945] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1010
[2012-04-19 11:03:27.240966] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-4777-2012/04/19-10:26:07:5771-m3d-client-0
[2012-04-19 11:04:12.599442] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1017 (version: 3.2.6)
[2012-04-19 11:35:35.292689] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1017)
[2012-04-19 11:35:35.292772] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1017
[2012-04-19 11:35:35.292789] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-9818-2012/04/19-11:04:08:591073-m3d-client-0
[2012-04-19 11:36:21.853812] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1010 (version: 3.2.6)
[2012-04-19 11:47:18.734382] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1010)
[2012-04-19 11:47:18.734469] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1010
[2012-04-19 11:47:18.734491] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-14556-2012/04/19-11:36:17:845197-m3d-client-0
[2012-04-19 11:47:39.217050] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1017 (version: 3.2.6)
[2012-04-19 15:02:24.770279] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 15:02:24.781548] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-19 15:02:24.781898] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-19 15:02:24.781921] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-31419-2012/04/18-20:50:43:167372-m3d-client-0
[2012-04-19 15:02:25.894312] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1022)
[2012-04-19 15:02:25.894371] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1022
[2012-04-19 15:02:25.894392] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-2466-2012/04/18-19:20:07:740059-m3d-client-0
[2012-04-19 15:02:26.125441] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1017)
[2012-04-19 15:02:26.125502] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1017
[2012-04-19 15:02:26.125524] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-24675-2012/04/18-20:50:45:84931-m3d-client-0
[2012-04-19 15:02:29.518860] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1016 (version: 3.2.6)
[2012-04-19 15:02:29.822559] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1015 (version: 3.2.6)
[2012-04-19 15:02:29.842807] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1014 (version: 3.2.6)
[2012-04-19 15:02:31.131997] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1018 (version: 3.2.6)
[2012-04-19 15:02:31.348626] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1013 (version: 3.2.6)
[2012-04-19 15:02:34.309791] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1015)
[2012-04-19 15:02:34.309870] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1015
[2012-04-19 15:02:34.309892] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-8037-2012/04/19-15:02:25:810729-m3d-client-0
[2012-04-19 15:07:34.558715] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 15:07:34.567782] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1014)
[2012-04-19 15:07:34.567863] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1014
[2012-04-19 15:07:34.567884] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-8034-2012/04/19-15:02:25:792337-m3d-client-0
[2012-04-19 15:07:35.581684] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-19 15:07:35.596268] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1013)
[2012-04-19 15:07:35.596325] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1013
[2012-04-19 15:07:35.596349] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-18494-2012/04/19-15:02:27:247724-m3d-client-0
[2012-04-19 15:07:35.638973] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1018)
[2012-04-19 15:07:35.639006] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1018
[2012-04-19 15:07:35.639024] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-3561-2012/04/19-13:31:47:554568-m3d-client-0
[2012-04-19 15:07:39.606811] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-19 15:07:40.655546] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1017 (version: 3.2.6)
[2012-04-19 15:07:40.734755] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1022 (version: 3.2.6)
[2012-04-19 15:07:43.296066] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 15:07:43.305593] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-19 15:07:43.305675] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-19 15:07:43.305698] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-8765-2012/04/19-15:07:35:577203-m3d-client-0
[2012-04-19 15:07:44.319571] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-19 15:07:44.334526] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1017)
[2012-04-19 15:07:44.334577] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1017
[2012-04-19 15:07:44.334598] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-21026-2012/04/19-15:07:36:661231-m3d-client-0
[2012-04-19 15:07:44.389015] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1022)
[2012-04-19 15:07:44.389079] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1022
[2012-04-19 15:07:44.389101] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-3573-2012/04/19-13:36:57:252321-m3d-client-0
[2012-04-19 15:07:48.345809] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1009 (version: 3.2.6)
[2012-04-19 15:07:49.394572] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1008 (version: 3.2.6)
[2012-04-19 15:07:49.485031] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1014 (version: 3.2.6)
[2012-04-19 15:07:53.51623] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 15:07:53.61189] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1009)
[2012-04-19 15:07:53.61266] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1009
[2012-04-19 15:07:53.61288] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-8795-2012/04/19-15:07:44:314905-m3d-client-0
[2012-04-19 15:07:54.75518] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-19 15:07:54.90273] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1008)
[2012-04-19 15:07:54.90332] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1008
[2012-04-19 15:07:54.90353] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-21033-2012/04/19-15:07:45:402472-m3d-client-0
[2012-04-19 15:07:54.155735] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1014)
[2012-04-19 15:07:54.155794] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1014
[2012-04-19 15:07:54.155816] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-3580-2012/04/19-13:37:06:1742-m3d-client-0
[2012-04-19 15:07:58.102753] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1003 (version: 3.2.6)
[2012-04-19 15:07:59.146312] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1002 (version: 3.2.6)
[2012-04-19 15:07:59.251753] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1010 (version: 3.2.6)
[2012-04-19 15:08:07.403334] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 15:08:07.412977] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1003)
[2012-04-19 15:08:07.413060] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1003
[2012-04-19 15:08:07.413082] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-8825-2012/04/19-15:07:54:70924-m3d-client-0
[2012-04-19 15:08:08.427150] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-19 15:08:08.441843] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1002)
[2012-04-19 15:08:08.442004] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1002
[2012-04-19 15:08:08.442030] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-21188-2012/04/19-15:07:55:155038-m3d-client-0
[2012-04-19 15:08:08.572696] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1010)
[2012-04-19 15:08:08.572767] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1010
[2012-04-19 15:08:08.572788] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-3587-2012/04/19-13:37:15:767882-m3d-client-0
[2012-04-19 15:08:12.452741] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:993 (version: 3.2.6)
[2012-04-19 15:08:13.498060] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:996 (version: 3.2.6)
[2012-04-19 15:08:13.668727] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1006 (version: 3.2.6)
[2012-04-19 15:08:19.861472] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:987 (version: 3.2.6)
[2012-04-19 15:08:20.86443] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:987)
[2012-04-19 15:08:20.86525] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:987
[2012-04-19 15:08:20.86546] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-8892-2012/04/19-15:08:15:852652-m3d-client-0
[2012-04-19 15:08:28.471172] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:981 (version: 3.2.6)
[2012-04-19 15:08:28.696362] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:981)
[2012-04-19 15:08:28.696440] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:981
[2012-04-19 15:08:28.696461] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-8925-2012/04/19-15:08:24:462307-m3d-client-0
[2012-04-19 15:08:34.249520] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1021 (version: 3.2.6)
[2012-04-19 15:08:34.493538] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1021)
[2012-04-19 15:08:34.493612] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1021
[2012-04-19 15:08:34.493632] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-8949-2012/04/19-15:08:30:240469-m3d-client-0
[2012-04-19 15:10:20.739815] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 15:10:20.749556] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:993)
[2012-04-19 15:10:20.749632] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:993
[2012-04-19 15:10:20.749653] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-8871-2012/04/19-15:08:08:422449-m3d-client-0
[2012-04-19 15:10:21.763205] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-19 15:10:21.777999] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:996)
[2012-04-19 15:10:21.778059] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:996
[2012-04-19 15:10:21.778081] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-21199-2012/04/19-15:08:09:504800-m3d-client-0
[2012-04-19 15:10:21.828224] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1006)
[2012-04-19 15:10:21.828284] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1006
[2012-04-19 15:10:21.828305] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-3594-2012/04/19-13:37:30:184506-m3d-client-0
[2012-04-19 15:10:25.789153] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-19 15:10:26.833545] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1017 (version: 3.2.6)
[2012-04-19 15:10:26.924256] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1022 (version: 3.2.6)
[2012-04-19 15:10:34.119332] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 15:10:34.128646] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-19 15:10:34.128763] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-19 15:10:34.128786] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-9193-2012/04/19-15:10:21:758662-m3d-client-0
[2012-04-19 15:10:35.143026] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-19 15:10:35.157793] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1017)
[2012-04-19 15:10:35.157843] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1017
[2012-04-19 15:10:35.157865] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-22242-2012/04/19-15:10:22:839296-m3d-client-0
[2012-04-19 15:10:35.219737] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1022)
[2012-04-19 15:10:35.219794] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1022
[2012-04-19 15:10:35.219816] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-3607-2012/04/19-13:39:43:433948-m3d-client-0
[2012-04-19 15:10:39.168134] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1010 (version: 3.2.6)
[2012-04-19 15:10:39.363378] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 15:10:39.371115] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1010)
[2012-04-19 15:10:39.371189] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1010
[2012-04-19 15:10:39.371209] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-9231-2012/04/19-15:10:35:138376-m3d-client-0
[2012-04-19 15:10:40.213845] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1011 (version: 3.2.6)
[2012-04-19 15:10:40.315754] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1017 (version: 3.2.6)
[2012-04-19 15:10:40.382952] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-19 15:10:40.397763] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1011)
[2012-04-19 15:10:40.397901] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1011
[2012-04-19 15:10:40.397924] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-22396-2012/04/19-15:10:36:219117-m3d-client-0
[2012-04-19 15:10:40.436657] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1017)
[2012-04-19 15:10:40.436702] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1017
[2012-04-19 15:10:40.436733] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-3614-2012/04/19-13:39:56:824548-m3d-client-0
[2012-04-19 15:10:44.406235] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1006 (version: 3.2.6)
[2012-04-19 15:10:45.118016] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 15:10:45.127479] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1006)
[2012-04-19 15:10:45.127567] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1006
[2012-04-19 15:10:45.127593] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-9261-2012/04/19-15:10:40:378378-m3d-client-0
[2012-04-19 15:10:45.456242] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1005 (version: 3.2.6)
[2012-04-19 15:10:45.532441] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1012 (version: 3.2.6)
[2012-04-19 15:10:46.141621] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-19 15:10:46.156320] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1005)
[2012-04-19 15:10:46.156376] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1005
[2012-04-19 15:10:46.156404] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-22403-2012/04/19-15:10:41:460812-m3d-client-0
[2012-04-19 15:10:46.220325] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1012)
[2012-04-19 15:10:46.220360] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1012
[2012-04-19 15:10:46.220378] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-3621-2012/04/19-13:40:02:41494-m3d-client-0
[2012-04-19 15:10:50.166311] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1000 (version: 3.2.6)
[2012-04-19 15:10:51.217108] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:999 (version: 3.2.6)
[2012-04-19 15:10:51.316814] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1008 (version: 3.2.6)
[2012-04-19 15:11:01.605238] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:994 (version: 3.2.6)
[2012-04-19 15:11:01.841812] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:994)
[2012-04-19 15:11:01.841882] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:994
[2012-04-19 15:11:01.841903] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-9328-2012/04/19-15:10:57:596345-m3d-client-0
[2012-04-19 15:12:33.796963] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-19 15:12:34.33239] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-19 15:12:34.33311] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-19 15:12:34.33331] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-9531-2012/04/19-15:12:29:788039-m3d-client-0
[2012-04-19 15:14:04.105332] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-19 15:14:05.363087] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-19 15:14:05.363179] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-19 15:14:05.363201] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-9738-2012/04/19-15:14:01:88049-m3d-client-0
[2012-04-19 15:14:11.759522] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1010 (version: 3.2.6)
[2012-04-19 15:14:12.42133] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1010)
[2012-04-19 15:14:12.42192] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1010
[2012-04-19 15:14:12.42210] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-9770-2012/04/19-15:14:07:751561-m3d-client-0
[2012-04-19 15:14:17.191064] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1004 (version: 3.2.6)
[2012-04-19 15:14:17.433806] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1004)
[2012-04-19 15:14:17.433884] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1004
[2012-04-19 15:14:17.433916] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-9794-2012/04/19-15:14:13:181410-m3d-client-0
[2012-04-19 15:14:22.654895] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:993 (version: 3.2.6)
[2012-04-19 15:14:22.928572] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:993)
[2012-04-19 15:14:22.928633] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:993
[2012-04-19 15:14:22.928654] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-9834-2012/04/19-15:14:18:645175-m3d-client-0
[2012-04-19 15:14:37.611276] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:987 (version: 3.2.6)
[2012-04-19 15:14:37.847262] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:987)
[2012-04-19 15:14:37.847345] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:987
[2012-04-19 15:14:37.847365] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-9874-2012/04/19-15:14:33:602213-m3d-client-0
[2012-04-19 15:15:02.313415] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1019 (version: 3.2.6)
[2012-04-19 15:15:02.550428] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1019)
[2012-04-19 15:15:02.550521] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1019
[2012-04-19 15:15:02.550554] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-9939-2012/04/19-15:14:58:304235-m3d-client-0
[2012-04-19 15:16:55.758952] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 15:16:55.768614] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1000)
[2012-04-19 15:16:55.768735] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1000
[2012-04-19 15:16:55.768758] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-9284-2012/04/19-15:10:46:137130-m3d-client-0
[2012-04-19 15:16:56.782902] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-19 15:16:56.797636] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:999)
[2012-04-19 15:16:56.797697] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:999
[2012-04-19 15:16:56.797719] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-22558-2012/04/19-15:10:47:220106-m3d-client-0
[2012-04-19 15:16:56.827603] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1008)
[2012-04-19 15:16:56.827640] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1008
[2012-04-19 15:16:56.827658] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-3628-2012/04/19-13:40:07:824831-m3d-client-0
[2012-04-19 15:17:00.807260] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-19 15:17:01.852932] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1017 (version: 3.2.6)
[2012-04-19 15:17:01.923386] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1022 (version: 3.2.6)
[2012-04-19 15:18:39.837320] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1021 (version: 3.2.6)
[2012-04-19 15:18:40.72133] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1021)
[2012-04-19 15:18:40.72201] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1021
[2012-04-19 15:18:40.72220] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-10390-2012/04/19-15:18:35:828010-m3d-client-0
[2012-04-19 15:18:49.5285] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1007 (version: 3.2.6)
[2012-04-19 15:18:49.253891] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1007)
[2012-04-19 15:18:49.253974] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1007
[2012-04-19 15:18:49.254002] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-10422-2012/04/19-15:18:44:997129-m3d-client-0
[2012-04-19 15:18:54.397576] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:999 (version: 3.2.6)
[2012-04-19 15:18:54.655577] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:999)
[2012-04-19 15:18:54.655667] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:999
[2012-04-19 15:18:54.655691] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-10446-2012/04/19-15:18:50:388670-m3d-client-0
[2012-04-19 15:19:00.229017] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:993 (version: 3.2.6)
[2012-04-19 15:19:00.494045] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:993)
[2012-04-19 15:19:00.494130] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:993
[2012-04-19 15:19:00.494151] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-10479-2012/04/19-15:18:56:221557-m3d-client-0
[2012-04-19 15:19:05.506657] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:987 (version: 3.2.6)
[2012-04-19 15:19:05.759585] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:987)
[2012-04-19 15:19:05.759654] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:987
[2012-04-19 15:19:05.759675] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-10504-2012/04/19-15:19:01:498218-m3d-client-0
[2012-04-19 15:19:10.771869] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:981 (version: 3.2.6)
[2012-04-19 15:19:11.8034] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:981)
[2012-04-19 15:19:11.8105] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:981
[2012-04-19 15:19:11.8126] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-10528-2012/04/19-15:19:06:762524-m3d-client-0
[2012-04-19 15:19:40.492214] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1021 (version: 3.2.6)
[2012-04-19 15:19:40.746381] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1021)
[2012-04-19 15:19:40.746445] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1021
[2012-04-19 15:19:40.746461] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-10600-2012/04/19-15:19:36:483824-m3d-client-0
[2012-04-19 15:25:36.372763] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 15:25:36.382484] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-19 15:25:36.382580] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-19 15:25:36.382601] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-10181-2012/04/19-15:16:56:778392-m3d-client-0
[2012-04-19 15:25:37.396478] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-19 15:25:37.411309] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1017)
[2012-04-19 15:25:37.411475] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1017
[2012-04-19 15:25:37.411500] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-25380-2012/04/19-15:16:57:852857-m3d-client-0
[2012-04-19 15:25:37.447177] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1022)
[2012-04-19 15:25:37.447229] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1022
[2012-04-19 15:25:37.447251] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-3635-2012/04/19-13:46:18:415633-m3d-client-0
[2012-04-19 15:25:41.423100] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1021 (version: 3.2.6)
[2012-04-19 15:25:42.467298] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1014 (version: 3.2.6)
[2012-04-19 15:25:42.543438] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1018 (version: 3.2.6)
[2012-04-19 15:26:40.108198] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-19 15:26:40.356424] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-19 15:26:40.356495] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-19 15:26:40.356518] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-11464-2012/04/19-15:26:36:99098-m3d-client-0
[2012-04-19 15:26:49.563226] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1007 (version: 3.2.6)
[2012-04-19 15:26:49.865667] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1007)
[2012-04-19 15:26:49.865739] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1007
[2012-04-19 15:26:49.865760] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-11496-2012/04/19-15:26:45:554627-m3d-client-0
[2012-04-19 15:26:55.281369] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:999 (version: 3.2.6)
[2012-04-19 15:26:55.527619] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:999)
[2012-04-19 15:26:55.527715] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:999
[2012-04-19 15:26:55.527737] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-11521-2012/04/19-15:26:51:272661-m3d-client-0
[2012-04-19 15:32:36.476728] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1017)
[2012-04-19 15:32:36.476877] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1017
[2012-04-19 15:32:36.476901] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-16251-2012/04/19-11:47:35:207882-m3d-client-0
[2012-04-19 15:32:36.476920] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1016)
[2012-04-19 15:32:36.476962] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1016
[2012-04-19 15:32:36.476979] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-16251-2012/04/19-11:47:35:207882-m3d-client-0
[2012-04-19 15:35:00.792337] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-19 15:35:01.29817] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-19 15:35:01.29889] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-19 15:35:01.29910] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-12636-2012/04/19-15:34:56:782763-m3d-client-0
[2012-04-19 15:35:26.366664] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1010 (version: 3.2.6)
[2012-04-19 15:35:47.457007] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1005 (version: 3.2.6)
[2012-04-19 15:35:47.696185] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1005)
[2012-04-19 15:35:47.696253] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1005
[2012-04-19 15:35:47.696274] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-12813-2012/04/19-15:35:43:447322-m3d-client-0
[2012-04-19 15:38:43.714016] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-19 15:38:43.953232] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-19 15:38:43.953312] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-19 15:38:43.953333] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-13177-2012/04/19-15:38:39:706428-m3d-client-0
[2012-04-19 15:44:37.661092] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1010)
[2012-04-19 15:44:37.661187] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1010
[2012-04-19 15:44:37.661209] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-12751-2012/04/19-15:35:22:332873-m3d-client-0
[2012-04-19 15:47:34.210657] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1017 (version: 3.2.6)
[2012-04-19 15:48:54.227370] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1019 (version: 3.2.6)
[2012-04-19 15:48:54.466405] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1019)
[2012-04-19 15:48:54.466501] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1019
[2012-04-19 15:48:54.466523] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-14651-2012/04/19-15:48:50:219540-m3d-client-0
[2012-04-19 15:49:18.153063] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1013 (version: 3.2.6)
[2012-04-19 15:49:18.403979] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1013)
[2012-04-19 15:49:18.404051] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1013
[2012-04-19 15:49:18.404071] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-14709-2012/04/19-15:49:14:145698-m3d-client-0
[2012-04-19 15:49:38.126463] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1002 (version: 3.2.6)
[2012-04-19 15:49:38.376494] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1002)
[2012-04-19 15:49:38.376584] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1002
[2012-04-19 15:49:38.376606] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-14766-2012/04/19-15:49:34:117211-m3d-client-0
[2012-04-19 15:49:43.990568] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:996 (version: 3.2.6)
[2012-04-19 15:49:44.230532] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:996)
[2012-04-19 15:49:44.230630] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:996
[2012-04-19 15:49:44.230654] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-14790-2012/04/19-15:49:39:982460-m3d-client-0
[2012-04-19 15:49:51.852398] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1012 (version: 3.2.6)
[2012-04-19 15:49:52.89732] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1012)
[2012-04-19 15:49:52.89796] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1012
[2012-04-19 15:49:52.89817] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-14823-2012/04/19-15:49:47:843262-m3d-client-0
[2012-04-19 15:50:56.370226] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1019 (version: 3.2.6)
[2012-04-19 15:50:56.607805] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1019)
[2012-04-19 15:50:56.607892] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1019
[2012-04-19 15:50:56.607912] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-14960-2012/04/19-15:50:52:361249-m3d-client-0
[2012-04-19 16:14:21.991610] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1019 (version: 3.2.6)
[2012-04-19 16:14:22.229499] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1019)
[2012-04-19 16:14:22.229584] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1019
[2012-04-19 16:14:22.229605] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-17638-2012/04/19-16:14:17:982327-m3d-client-0
[2012-04-19 16:15:49.252250] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 16:15:49.262504] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1021)
[2012-04-19 16:15:49.262604] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1021
[2012-04-19 16:15:49.262626] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-11346-2012/04/19-15:25:37:391976-m3d-client-0
[2012-04-19 16:15:50.276974] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-19 16:15:50.289201] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1014)
[2012-04-19 16:15:50.289254] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1014
[2012-04-19 16:15:50.289277] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-29387-2012/04/19-15:25:38:460802-m3d-client-0
[2012-04-19 16:15:50.330439] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1018)
[2012-04-19 16:15:50.330500] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1018
[2012-04-19 16:15:50.330522] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-3642-2012/04/19-13:54:59:11625-m3d-client-0
[2012-04-19 16:15:54.303145] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1019 (version: 3.2.6)
[2012-04-19 16:15:55.347256] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1017 (version: 3.2.6)
[2012-04-19 16:15:55.426451] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1022 (version: 3.2.6)
[2012-04-19 16:16:09.436949] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1010 (version: 3.2.6)
[2012-04-19 16:16:09.676780] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1010)
[2012-04-19 16:16:09.676872] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1010
[2012-04-19 16:16:09.676893] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-17879-2012/04/19-16:16:05:428043-m3d-client-0
[2012-04-19 16:18:02.839531] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1021 (version: 3.2.6)
[2012-04-19 16:18:03.80389] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1021)
[2012-04-19 16:18:03.80461] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1021
[2012-04-19 16:18:03.80482] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-18119-2012/04/19-16:17:58:830587-m3d-client-0
[2012-04-19 16:18:10.780257] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1008 (version: 3.2.6)
[2012-04-19 16:18:11.20858] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1008)
[2012-04-19 16:18:11.20958] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1008
[2012-04-19 16:18:11.20992] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-18151-2012/04/19-16:18:06:771954-m3d-client-0
[2012-04-19 16:18:16.332696] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1002 (version: 3.2.6)
[2012-04-19 16:18:16.572891] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1002)
[2012-04-19 16:18:16.572959] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1002
[2012-04-19 16:18:16.572980] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-18175-2012/04/19-16:18:12:323896-m3d-client-0
[2012-04-19 16:19:10.812359] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1021 (version: 3.2.6)
[2012-04-19 16:19:11.52848] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1021)
[2012-04-19 16:19:11.52928] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1021
[2012-04-19 16:19:11.52949] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-18297-2012/04/19-16:19:06:803134-m3d-client-0
[2012-04-19 16:19:58.954799] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1017)
[2012-04-19 16:19:58.954928] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1017
[2012-04-19 16:19:58.954950] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-14428-2012/04/19-15:47:30:202038-m3d-client-0
[2012-04-19 16:20:20.181133] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1010 (version: 3.2.6)
[2012-04-19 16:25:40.305879] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 16:25:40.315469] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1019)
[2012-04-19 16:25:40.315567] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1019
[2012-04-19 16:25:40.315589] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-17842-2012/04/19-16:15:50:272445-m3d-client-0
[2012-04-19 16:25:41.328419] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-19 16:25:41.343445] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1017)
[2012-04-19 16:25:41.343495] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1017
[2012-04-19 16:25:41.343518] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-20573-2012/04/19-16:15:51:303207-m3d-client-0
[2012-04-19 16:25:41.382487] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1022)
[2012-04-19 16:25:41.382547] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1022
[2012-04-19 16:25:41.382570] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-3671-2012/04/19-14:45:11:758994-m3d-client-0
[2012-04-19 16:25:45.352865] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-19 16:25:46.403251] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1014 (version: 3.2.6)
[2012-04-19 16:25:46.478706] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1018 (version: 3.2.6)
[2012-04-19 16:25:59.41908] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 16:25:59.51368] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-19 16:25:59.51469] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-19 16:25:59.51498] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-19292-2012/04/19-16:25:41:323847-m3d-client-0
[2012-04-19 16:26:00.65394] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-19 16:26:00.80330] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1014)
[2012-04-19 16:26:00.80378] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1014
[2012-04-19 16:26:00.80400] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-25177-2012/04/19-16:25:42:349239-m3d-client-0
[2012-04-19 16:26:00.140796] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1018)
[2012-04-19 16:26:00.140831] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1018
[2012-04-19 16:26:00.140849] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-3686-2012/04/19-14:55:02:784276-m3d-client-0
[2012-04-19 16:26:04.91847] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1013 (version: 3.2.6)
[2012-04-19 16:26:05.138871] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1008 (version: 3.2.6)
[2012-04-19 16:26:05.236346] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1014 (version: 3.2.6)
[2012-04-19 16:26:17.635275] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1002 (version: 3.2.6)
[2012-04-19 16:26:17.877467] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1002)
[2012-04-19 16:26:17.877552] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1002
[2012-04-19 16:26:17.877577] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-19376-2012/04/19-16:26:13:626390-m3d-client-0
[2012-04-19 16:27:58.11470] W [marker-quota.c:1307:mq_inodelk_cbk] 0-m3d-marker: unlocking on path (/) failed (Invalid argument)
[2012-04-19 16:29:25.438276] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 16:29:25.446168] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1013)
[2012-04-19 16:29:25.446253] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1013
[2012-04-19 16:29:25.446275] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-19339-2012/04/19-16:26:00:60907-m3d-client-0
[2012-04-19 16:29:26.460582] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-19 16:29:26.475469] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1008)
[2012-04-19 16:29:26.475632] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1008
[2012-04-19 16:29:26.475661] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-25332-2012/04/19-16:26:01:88288-m3d-client-0
[2012-04-19 16:29:26.519081] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1014)
[2012-04-19 16:29:26.519134] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1014
[2012-04-19 16:29:26.519156] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-3693-2012/04/19-14:55:21:541252-m3d-client-0
[2012-04-19 16:29:30.486392] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-19 16:29:31.541135] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1017 (version: 3.2.6)
[2012-04-19 16:29:31.615105] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1022 (version: 3.2.6)
[2012-04-19 16:29:34.214630] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1014 (version: 3.2.6)
[2012-04-19 16:29:34.456734] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1014)
[2012-04-19 16:29:34.456846] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1014
[2012-04-19 16:29:34.456869] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-19777-2012/04/19-16:29:30:206119-m3d-client-0
[2012-04-19 16:30:41.701433] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 16:30:41.712324] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-19 16:30:41.712452] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-19 16:30:41.712477] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-19756-2012/04/19-16:29:26:455973-m3d-client-0
[2012-04-19 16:30:42.722551] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-19 16:30:42.740922] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1017)
[2012-04-19 16:30:42.741021] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1017
[2012-04-19 16:30:42.741040] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-26965-2012/04/19-16:29:27:482011-m3d-client-0
[2012-04-19 16:30:42.824880] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1022)
[2012-04-19 16:30:42.824945] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1022
[2012-04-19 16:30:42.824965] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-3700-2012/04/19-14:58:47:910617-m3d-client-0
[2012-04-19 16:30:46.749317] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1019 (version: 3.2.6)
[2012-04-19 16:30:47.805228] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1014 (version: 3.2.6)
[2012-04-19 16:30:48.10353] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1018 (version: 3.2.6)
[2012-04-19 16:32:44.583503] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-19 16:32:44.829419] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-19 16:32:44.829518] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-19 16:32:44.829549] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-20201-2012/04/19-16:32:40:574699-m3d-client-0
[2012-04-19 16:35:42.613670] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-19 16:35:42.859280] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-19 16:35:42.859382] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-19 16:35:42.859403] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-20566-2012/04/19-16:35:38:605019-m3d-client-0
[2012-04-19 16:35:53.287795] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1010)
[2012-04-19 16:35:53.287916] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1010
[2012-04-19 16:35:53.287942] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-18630-2012/04/19-16:20:16:172825-m3d-client-0
[2012-04-19 16:36:21.662757] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1011 (version: 3.2.6)
[2012-04-19 16:37:11.703923] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-19 16:37:11.713362] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1019)
[2012-04-19 16:37:11.713443] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1019
[2012-04-19 16:37:11.713466] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-19931-2012/04/19-16:30:42:718462-m3d-client-0
[2012-04-19 16:37:12.728374] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-19 16:37:12.743245] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.193:1014)
[2012-04-19 16:37:12.743309] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.193:1014
[2012-04-19 16:37:12.743326] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of mdx-27561-2012/04/19-16:30:43:741827-m3d-client-0
[2012-04-19 16:37:12.790717] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1018)
[2012-04-19 16:37:12.790773] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1018
[2012-04-19 16:37:12.790796] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-3707-2012/04/19-15:00:04:228413-m3d-client-0
[2012-04-19 16:37:16.755744] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-19 16:37:17.799538] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.193:1017 (version: 3.2.6)
[2012-04-19 16:37:17.886988] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1022 (version: 3.2.6)
[2012-04-19 16:37:31.83761] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1014 (version: 3.2.6)
[2012-04-19 16:37:31.331050] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1014)
[2012-04-19 16:37:31.331124] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1014
[2012-04-19 16:37:31.331151] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-20994-2012/04/19-16:37:27:74405-m3d-client-0
[2012-04-19 16:38:41.585604] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1021 (version: 3.2.6)
[2012-04-19 16:38:41.833348] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1021)
[2012-04-19 16:38:41.833437] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1021
[2012-04-19 16:38:41.833459] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-21182-2012/04/19-16:38:37:576983-m3d-client-0
[2012-04-19 16:39:06.780006] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1012 (version: 3.2.6)
[2012-04-19 16:39:07.51014] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1012)
[2012-04-19 16:39:07.51109] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1012
[2012-04-19 16:39:07.51130] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-21247-2012/04/19-16:39:02:771116-m3d-client-0
[2012-04-19 16:39:14.219162] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1004 (version: 3.2.6)
[2012-04-19 16:39:14.490824] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1004)
[2012-04-19 16:39:14.490918] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1004
[2012-04-19 16:39:14.490967] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-21275-2012/04/19-16:39:10:210686-m3d-client-0
[2012-04-19 16:39:54.752141] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1021 (version: 3.2.6)
[2012-04-19 16:39:54.998586] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1021)
[2012-04-19 16:39:54.998655] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1021
[2012-04-19 16:39:54.998676] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-21374-2012/04/19-16:39:50:743798-m3d-client-0
[2012-04-19 16:40:01.52259] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:996 (version: 3.2.6)
[2012-04-19 16:40:01.300675] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:996)
[2012-04-19 16:40:01.300770] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:996
[2012-04-19 16:40:01.300794] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-21406-2012/04/19-16:39:57:43584-m3d-client-0
[2012-04-19 17:43:58.233253] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1021 (version: 3.2.6)
[2012-04-19 17:43:58.481758] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1021)
[2012-04-19 17:43:58.481857] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1021
[2012-04-19 17:43:58.481878] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-29208-2012/04/19-17:43:54:224942-m3d-client-0
[2012-04-19 19:48:12.201039] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1021 (version: 3.2.6)
[2012-04-19 19:48:12.452470] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1021)
[2012-04-19 19:48:12.452564] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1021
[2012-04-19 19:48:12.452585] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-11095-2012/04/19-19:48:08:191034-m3d-client-0
[2012-04-19 19:49:13.506909] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1021 (version: 3.2.6)
[2012-04-19 19:49:13.749573] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1021)
[2012-04-19 19:49:13.749636] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1021
[2012-04-19 19:49:13.749657] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-11224-2012/04/19-19:49:09:498512-m3d-client-0
[2012-04-19 19:49:32.934764] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1012 (version: 3.2.6)
[2012-04-19 19:49:33.181959] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1012)
[2012-04-19 19:49:33.182034] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1012
[2012-04-19 19:49:33.182054] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-11280-2012/04/19-19:49:28:925962-m3d-client-0
[2012-04-19 19:55:47.769408] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1021 (version: 3.2.6)
[2012-04-19 19:55:48.16538] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1021)
[2012-04-19 19:55:48.16607] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1021
[2012-04-19 19:55:48.16628] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-11999-2012/04/19-19:55:43:760772-m3d-client-0
[2012-04-20 10:15:31.254556] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1011)
[2012-04-20 10:15:31.255195] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1011
[2012-04-20 10:15:31.255550] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-20829-2012/04/19-16:36:17:654496-m3d-client-0
[2012-04-20 10:15:50.738346] W [glusterfsd.c:727:cleanup_and_exit] (-->/usr/lib/libgfrpc.so.0(rpcsvc_notify+0x9b) [0x7f6c61f3e6eb] (-->/usr/lib/libgfrpc.so.0(rpcsvc_handle_rpc_call+0x29f) [0x7f6c61f3e13f] (-->/usr/sbin/glusterfsd(glusterfs_handle_terminate+0x1d) [0x7f6c625dee1d]))) 0-: received signum (15), shutting down
[2012-04-20 10:15:50.738443] W [glusterfsd.c:727:cleanup_and_exit] (-->/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f6c6165090d] (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7f6c61905b50] (-->/usr/sbin/glusterfsd(glusterfs_sigwaiter+0xd5) [0x7f6c625de325]))) 0-: received signum (15), shutting down
[2012-04-20 10:39:59.321425] I [glusterfsd.c:1493:main] 0-/usr/sbin/glusterfsd: Started running /usr/sbin/glusterfsd version 3.2.6
[2012-04-20 10:39:59.326519] W [socket.c:419:__socket_keepalive] 0-socket: failed to set keep idle on socket 8
[2012-04-20 10:39:59.326590] W [socket.c:1846:socket_server_event_handler] 0-socket.glusterfsd: Failed to set keep-alive: Operation not supported
[2012-04-20 10:39:59.348820] W [graph.c:291:gf_add_cmdline_options] 0-m3d-server: adding option 'listen-port' for volume 'm3d-server' with value '24010'
[2012-04-20 10:39:59.349922] W [rpc-transport.c:447:validate_volume_options] 0-tcp.m3d-server: option 'listen-port' is deprecated, preferred is 'transport.socket.listen-port', continuing with correction
Given volfile:
+------------------------------------------------------------------------------+
1: volume m3d-posix
2: type storage/posix
3: option directory /g0
4: end-volume
5:
6: volume m3d-access-control
7: type features/access-control
8: subvolumes m3d-posix
9: end-volume
10:
11: volume m3d-locks
12: type features/locks
13: subvolumes m3d-access-control
14: end-volume
15:
16: volume m3d-io-threads
17: type performance/io-threads
18: subvolumes m3d-locks
19: end-volume
20:
21: volume m3d-marker
22: type features/marker
23: option volume-uuid c793c8a9-f409-4a82-a6eb-1fefb1699486
24: option timestamp-file /etc/glusterd/vols/m3d/marker.tstamp
25: option xtime off
26: option quota on
27: subvolumes m3d-io-threads
28: end-volume
29:
30: volume /g0
31: type debug/io-stats
32: option latency-measurement off
33: option count-fop-hits off
34: subvolumes m3d-marker
35: end-volume
36:
37: volume m3d-server
38: type protocol/server
39: option transport-type tcp
40: option auth.addr./g0.allow 194.12.*,130.204.198.50
41: subvolumes /g0
42: end-volume
+------------------------------------------------------------------------------+
[2012-04-20 10:40:03.370810] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-20 10:40:03.377339] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1022 (version: 3.2.6)
[2012-04-20 10:41:04.584438] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1020 (version: 3.2.6)
[2012-04-20 10:55:08.557994] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1018 (version: 3.2.6)
[2012-04-20 10:55:08.779921] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1018)
[2012-04-20 10:55:08.780008] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1018
[2012-04-20 10:55:08.780028] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-27421-2012/04/20-10:55:04:549840-m3d-client-0
[2012-04-20 11:03:11.430346] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1022)
[2012-04-20 11:03:11.430402] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1022
[2012-04-20 11:03:11.430429] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-5397-2012/04/20-09:09:16:762438-m3d-client-0
[2012-04-20 11:03:12.463033] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-20 11:03:12.471952] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-20 11:03:12.472030] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-20 11:03:12.472052] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-21717-2012/04/20-10:39:59:341988-m3d-client-0
[2012-04-20 11:03:13.486228] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-20 11:03:16.518663] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1021 (version: 3.2.6)
[2012-04-20 11:03:17.512588] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1018 (version: 3.2.6)
[2012-04-20 11:04:14.459132] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1022 (version: 3.2.6)
[2012-04-20 11:04:14.688729] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1022)
[2012-04-20 11:04:14.688793] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1022
[2012-04-20 11:04:14.688813] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-5443-2012/04/20-09:33:27:828715-m3d-client-0
[2012-04-20 11:25:35.828767] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1022 (version: 3.2.6)
[2012-04-20 11:25:36.58339] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1022)
[2012-04-20 11:25:36.58418] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1022
[2012-04-20 11:25:36.58440] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-5474-2012/04/20-09:54:49:141803-m3d-client-0
[2012-04-20 11:27:00.599925] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-20 11:27:00.823420] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-20 11:27:00.823492] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-20 11:27:00.823513] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-31248-2012/04/20-11:26:56:589997-m3d-client-0
[2012-04-20 11:29:35.970388] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-20 11:29:36.190422] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-20 11:29:36.190513] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-20 11:29:36.190535] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-31562-2012/04/20-11:29:31:961550-m3d-client-0
[2012-04-20 11:30:32.440628] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-20 11:30:32.660736] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-20 11:30:32.660810] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-20 11:30:32.660832] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-31683-2012/04/20-11:30:28:431649-m3d-client-0
[2012-04-20 11:30:45.861251] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-20 11:30:45.870400] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1018)
[2012-04-20 11:30:45.870485] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1018
[2012-04-20 11:30:45.870506] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-28384-2012/04/20-11:03:13:481764-m3d-client-0
[2012-04-20 11:30:46.885922] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-20 11:30:46.902975] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1021)
[2012-04-20 11:30:46.903036] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1021
[2012-04-20 11:30:46.903066] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-5427-2012/04/20-09:32:29:854334-m3d-client-0
[2012-04-20 11:30:50.912731] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1016 (version: 3.2.6)
[2012-04-20 11:30:50.993571] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1022 (version: 3.2.6)
[2012-04-20 11:30:54.680997] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1013 (version: 3.2.6)
[2012-04-20 11:30:54.901831] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1013)
[2012-04-20 11:30:54.901902] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1013
[2012-04-20 11:30:54.901923] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-31753-2012/04/20-11:30:50:672471-m3d-client-0
[2012-04-20 11:31:59.478769] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-20 11:31:59.699848] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1023)
[2012-04-20 11:31:59.699940] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1023
[2012-04-20 11:31:59.699962] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-31897-2012/04/20-11:31:55:471376-m3d-client-0
[2012-04-20 11:32:06.881024] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1015 (version: 3.2.6)
[2012-04-20 11:32:07.179579] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1015)
[2012-04-20 11:32:07.179662] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1015
[2012-04-20 11:32:07.179689] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-31929-2012/04/20-11:32:02:869897-m3d-client-0
[2012-04-20 11:32:26.133004] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1010 (version: 3.2.6)
[2012-04-20 11:32:26.432156] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1010)
[2012-04-20 11:32:26.432267] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1010
[2012-04-20 11:32:26.432289] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-31978-2012/04/20-11:32:22:121780-m3d-client-0
[2012-04-20 11:32:33.43037] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1006 (version: 3.2.6)
[2012-04-20 11:32:33.264032] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1006)
[2012-04-20 11:32:33.264100] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1006
[2012-04-20 11:32:33.264130] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-32002-2012/04/20-11:32:29:32660-m3d-client-0
[2012-04-20 11:33:43.582885] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1020)
[2012-04-20 11:33:43.582960] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1020
[2012-04-20 11:33:43.582981] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-22191-2012/04/20-10:41:00:574876-m3d-client-0
[2012-04-20 11:34:43.624606] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1023 (version: 3.2.6)
[2012-04-20 11:35:02.729230] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1020 (version: 3.2.6)
[2012-04-20 11:35:02.951481] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1020)
[2012-04-20 11:35:02.951575] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1020
[2012-04-20 11:35:02.951596] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-32532-2012/04/20-11:34:58:720177-m3d-client-0
[2012-04-20 11:37:58.960950] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-20 11:37:58.969577] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1016)
[2012-04-20 11:37:58.969649] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1016
[2012-04-20 11:37:58.969668] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-31732-2012/04/20-11:30:46:881332-m3d-client-0
[2012-04-20 11:37:59.984152] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-20 11:38:00.641] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1022)
[2012-04-20 11:38:00.704] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1022
[2012-04-20 11:38:00.748] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-5488-2012/04/20-10:00:05:252681-m3d-client-0
[2012-04-20 11:38:04.11688] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1020 (version: 3.2.6)
[2012-04-20 11:38:04.92207] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1020 (version: 3.2.6)
[2012-04-20 11:39:54.919499] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1019 (version: 3.2.6)
[2012-04-20 11:39:55.142704] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1019)
[2012-04-20 11:39:55.142783] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1019
[2012-04-20 11:39:55.142804] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-791-2012/04/20-11:39:50:910483-m3d-client-0
[2012-04-20 11:41:06.949885] I [glusterfsd-mgmt.c:62:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2012-04-20 11:41:06.956634] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1020)
[2012-04-20 11:41:06.956726] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1020
[2012-04-20 11:41:06.956745] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-562-2012/04/20-11:37:59:979448-m3d-client-0
[2012-04-20 11:41:07.972649] I [glusterfsd-mgmt.c:637:mgmt_getspec_cbk] 0-: No change in volfile, continuing
[2012-04-20 11:41:07.988875] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.64:1020)
[2012-04-20 11:41:07.988935] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.64:1020
[2012-04-20 11:41:07.988957] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of g1-5505-2012/04/20-10:07:18:331448-m3d-client-0
[2012-04-20 11:41:11.997902] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1019 (version: 3.2.6)
[2012-04-20 11:41:12.80724] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.64:1022 (version: 3.2.6)
[2012-04-20 11:41:19.129857] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1013 (version: 3.2.6)
[2012-04-20 11:41:19.362386] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1013)
[2012-04-20 11:41:19.362488] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1013
[2012-04-20 11:41:19.362511] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-985-2012/04/20-11:41:15:122089-m3d-client-0
[2012-04-20 11:43:37.913437] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1020 (version: 3.2.6)
[2012-04-20 11:43:38.174457] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1020)
[2012-04-20 11:43:38.174514] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1020
[2012-04-20 11:43:38.174536] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-1277-2012/04/20-11:43:33:899211-m3d-client-0
[2012-04-20 11:43:47.35723] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1013 (version: 3.2.6)
[2012-04-20 11:43:47.282014] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1013)
[2012-04-20 11:43:47.282088] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1013
[2012-04-20 11:43:47.282109] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-1309-2012/04/20-11:43:43:26172-m3d-client-0
[2012-04-20 11:44:25.496644] I [server-handshake.c:542:server_setvolume] 0-m3d-server: accepted client from 194.12.234.101:1009 (version: 3.2.6)
[2012-04-20 11:44:25.751596] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.m3d-server: reading from socket failed. Error (Transport endpoint is not connected), peer (194.12.234.101:1009)
[2012-04-20 11:44:25.751658] I [server.c:438:server_rpc_notify] 0-m3d-server: disconnected connection from 194.12.234.101:1009
[2012-04-20 11:44:25.751679] I [server-helpers.c:783:server_connection_destroy] 0-m3d-server: destroyed connection of muzzy-1396-2012/04/20-11:44:21:487813-m3d-client-0
[2012-04-21 10:09:58.540970] W [glusterfsd.c:727:cleanup_and_exit] (-->/usr/lib/libgfrpc.so.0(rpcsvc_notify+0x9b) [0x7f5dd9fc36eb] (-->/usr/lib/libgfrpc.so.0(rpcsvc_handle_rpc_call+0x29f) [0x7f5dd9fc313f] (-->/usr/sbin/glusterfsd(glusterfs_handle_terminate+0x1d) [0x7f5dda663e1d]))) 0-: received signum (15), shutting down
[2012-04-21 10:09:58.541030] W [glusterfsd.c:727:cleanup_and_exit] (-->/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f5dd96d590d] (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7f5dd998ab50] (-->/usr/sbin/glusterfsd(glusterfs_sigwaiter+0xd5) [0x7f5dda663325]))) 0-: received signum (15), shutting down
[2012-04-19 15:47:30.212149] W [write-behind.c:3023:init] 0-m3d-write-behind: disabling write-behind for first 0 bytes
Given volfile:
+------------------------------------------------------------------------------+
1: volume m3d-client-0
2: type protocol/client
3: option remote-host g0
4: option remote-subvolume /g0
5: option transport-type tcp
6: end-volume
7:
8: volume m3d-client-1
9: type protocol/client
10: option remote-host g1
11: option remote-subvolume /g1
12: option transport-type tcp
13: end-volume
14:
15: volume m3d-client-2
16: type protocol/client
17: option remote-host g2
18: option remote-subvolume /g2
19: option transport-type tcp
20: end-volume
21:
22: volume m3d-dht
23: type cluster/distribute
24: subvolumes m3d-client-0 m3d-client-1 m3d-client-2
25: end-volume
26:
27: volume m3d-quota
28: type features/quota
29: option limit-set /1Gg:1GB,/10Gg:10GB,/5Gg:5GB,/512Mb:512MB,/dav/256MB:256MB,/dav/1GB:1GB,/dav/5GB:5GB,/dav/10GB:10GB,/cifs/256Mb:256MB
30: option timeout 5
31: subvolumes m3d-dht
32: end-volume
33:
34: volume m3d-write-behind
35: type performance/write-behind
36: subvolumes m3d-quota
37: end-volume
38:
39: volume m3d-read-ahead
40: type performance/read-ahead
41: subvolumes m3d-write-behind
42: end-volume
43:
44: volume m3d-io-cache
45: type performance/io-cache
46: subvolumes m3d-read-ahead
47: end-volume
48:
49: volume m3d-quick-read
50: type performance/quick-read
51: subvolumes m3d-io-cache
52: end-volume
53:
54: volume m3d-stat-prefetch
55: type performance/stat-prefetch
56: subvolumes m3d-quick-read
57: end-volume
58:
59: volume m3d
60: type debug/io-stats
61: option latency-measurement off
62: option count-fop-hits off
63: subvolumes m3d-stat-prefetch
64: end-volume
+------------------------------------------------------------------------------+
[2012-04-19 15:49:25.648902] W [fuse-bridge.c:1828:fuse_writev_cbk] 0-glusterfs-fuse: 277316: WRITE => -1 (Disk quota exceeded)
[2012-04-19 15:49:32.959453] W [fuse-bridge.c:1828:fuse_writev_cbk] 0-glusterfs-fuse: 356473: WRITE => -1 (Disk quota exceeded)
[2012-04-19 15:49:37.991495] W [fuse-bridge.c:1828:fuse_writev_cbk] 0-glusterfs-fuse: 390623: WRITE => -1 (Disk quota exceeded)
[2012-04-19 15:49:42.611505] W [fuse-bridge.c:1828:fuse_writev_cbk] 0-glusterfs-fuse: 432689: WRITE => -1 (Disk quota exceeded)
[2012-04-19 15:55:01.41308] W [fuse-bridge.c:1573:fuse_create_cbk] 0-glusterfs-fuse: 434684: /cifs/256Mb/.DS_Store => -1 (Disk quota exceeded)
[2012-04-19 15:56:18.186357] W [fuse-bridge.c:1828:fuse_writev_cbk] 0-glusterfs-fuse: 447584: WRITE => -1 (Disk quota exceeded)
[2012-04-19 16:15:50.278013] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7fc3d8c1addc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7fc3d8c1ae6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x443) [0x7fc3d4cec913]))) 0-dict: data is NULL
[2012-04-19 16:15:50.278076] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7fc3d8c1addc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7fc3d8c1ae6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x59d) [0x7fc3d4ceca6d]))) 0-dict: data is NULL
[2012-04-19 16:15:50.278126] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7fc3d8c1addc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7fc3d8c1ae6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x72f) [0x7fc3d4cecbff]))) 0-dict: data is NULL
[2012-04-19 16:15:50.278174] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7fc3d8c1addc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7fc3d8c1ae6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x74b) [0x7fc3d4cecc1b]))) 0-dict: data is NULL
[2012-04-19 16:19:58.950914] W [glusterfsd.c:727:cleanup_and_exit] (-->/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7fc3d810490d] (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7fc3d83b9b50] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xd5) [0x7fc3d9092325]))) 0-: received signum (15), shutting down
[2012-04-19 16:20:16.182324] W [write-behind.c:3023:init] 0-m3d-write-behind: disabling write-behind for first 0 bytes
Given volfile:
+------------------------------------------------------------------------------+
1: volume m3d-client-0
2: type protocol/client
3: option remote-host g0
4: option remote-subvolume /g0
5: option transport-type tcp
6: end-volume
7:
8: volume m3d-client-1
9: type protocol/client
10: option remote-host g1
11: option remote-subvolume /g1
12: option transport-type tcp
13: end-volume
14:
15: volume m3d-client-2
16: type protocol/client
17: option remote-host g2
18: option remote-subvolume /g2
19: option transport-type tcp
20: end-volume
21:
22: volume m3d-dht
23: type cluster/distribute
24: subvolumes m3d-client-0 m3d-client-1 m3d-client-2
25: end-volume
26:
27: volume m3d-quota
28: type features/quota
29: option limit-set /1Gg:1GB,/10Gg:10GB,/5Gg:5GB,/512Mb:512MB,/dav/256MB:256MB,/dav/1GB:1GB,/dav/5GB:5GB,/dav/10GB:10GB,/cifs/256Mb:256MB,/dav/128mb:128MB
30: option timeout 5
31: subvolumes m3d-dht
32: end-volume
33:
34: volume m3d-write-behind
35: type performance/write-behind
36: subvolumes m3d-quota
37: end-volume
38:
39: volume m3d-read-ahead
40: type performance/read-ahead
41: subvolumes m3d-write-behind
42: end-volume
43:
44: volume m3d-io-cache
45: type performance/io-cache
46: subvolumes m3d-read-ahead
47: end-volume
48:
49: volume m3d-quick-read
50: type performance/quick-read
51: subvolumes m3d-io-cache
52: end-volume
53:
54: volume m3d-stat-prefetch
55: type performance/stat-prefetch
56: subvolumes m3d-quick-read
57: end-volume
58:
59: volume m3d
60: type debug/io-stats
61: option latency-measurement off
62: option count-fop-hits off
63: subvolumes m3d-stat-prefetch
64: end-volume
+------------------------------------------------------------------------------+
[2012-04-19 16:21:13.419754] W [fuse-bridge.c:1828:fuse_writev_cbk] 0-glusterfs-fuse: 104522: WRITE => -1 (Disk quota exceeded)
[2012-04-19 16:21:22.65331] W [fuse-bridge.c:1828:fuse_writev_cbk] 0-glusterfs-fuse: 187270: WRITE => -1 (Disk quota exceeded)
[2012-04-19 16:21:27.301029] W [fuse-bridge.c:1828:fuse_writev_cbk] 0-glusterfs-fuse: 221873: WRITE => -1 (Disk quota exceeded)
[2012-04-19 16:21:32.581167] W [fuse-bridge.c:1828:fuse_writev_cbk] 0-glusterfs-fuse: 264403: WRITE => -1 (Disk quota exceeded)
[2012-04-19 16:21:37.594224] W [fuse-bridge.c:1828:fuse_writev_cbk] 0-glusterfs-fuse: 311826: WRITE => -1 (Disk quota exceeded)
[2012-04-19 16:21:42.529783] W [fuse-bridge.c:1828:fuse_writev_cbk] 0-glusterfs-fuse: 362903: WRITE => -1 (Disk quota exceeded)
[2012-04-19 16:21:46.742294] W [fuse-bridge.c:1354:fuse_rename_cbk] 0-glusterfs-fuse: 407678: /dav/128mb/Spook.Country/.davfs.tmp241ac9 -> /dav/128mb/Spook.Country/Spook Country-Part09.mp3 => -1 (Disk quota exceeded)
[2012-04-19 16:25:41.329581] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7f4763978ddc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7f4763978e6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x443) [0x7f475fa4a913]))) 0-dict: data is NULL
[2012-04-19 16:25:41.329640] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7f4763978ddc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7f4763978e6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x59d) [0x7f475fa4aa6d]))) 0-dict: data is NULL
[2012-04-19 16:25:41.329689] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7f4763978ddc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7f4763978e6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x72f) [0x7f475fa4abff]))) 0-dict: data is NULL
[2012-04-19 16:25:41.329738] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7f4763978ddc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7f4763978e6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x74b) [0x7f475fa4ac1b]))) 0-dict: data is NULL
[2012-04-19 16:26:00.66354] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7f4763978ddc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7f4763978e6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x443) [0x7f475fa4a913]))) 0-dict: data is NULL
[2012-04-19 16:26:00.66415] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7f4763978ddc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7f4763978e6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x59d) [0x7f475fa4aa6d]))) 0-dict: data is NULL
[2012-04-19 16:26:00.66464] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7f4763978ddc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7f4763978e6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x72f) [0x7f475fa4abff]))) 0-dict: data is NULL
[2012-04-19 16:26:00.66512] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7f4763978ddc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7f4763978e6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x74b) [0x7f475fa4ac1b]))) 0-dict: data is NULL
[2012-04-19 16:30:42.723365] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7f4763978ddc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7f4763978e6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x443) [0x7f475fa4a913]))) 0-dict: data is NULL
[2012-04-19 16:30:42.723412] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7f4763978ddc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7f4763978e6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x59d) [0x7f475fa4aa6d]))) 0-dict: data is NULL
[2012-04-19 16:30:42.723448] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7f4763978ddc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7f4763978e6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x72f) [0x7f475fa4abff]))) 0-dict: data is NULL
[2012-04-19 16:30:42.723518] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7f4763978ddc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7f4763978e6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x74b) [0x7f475fa4ac1b]))) 0-dict: data is NULL
[2012-04-19 16:35:53.283657] W [glusterfsd.c:727:cleanup_and_exit] (-->/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f4762e6290d] (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7f4763117b50] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xd5) [0x7f4763df0325]))) 0-: received signum (15), shutting down
[2012-04-19 16:36:17.663509] W [write-behind.c:3023:init] 0-m3d-write-behind: disabling write-behind for first 0 bytes
Given volfile:
+------------------------------------------------------------------------------+
1: volume m3d-client-0
2: type protocol/client
3: option remote-host g0
4: option remote-subvolume /g0
5: option transport-type tcp
6: end-volume
7:
8: volume m3d-client-1
9: type protocol/client
10: option remote-host g1
11: option remote-subvolume /g1
12: option transport-type tcp
13: end-volume
14:
15: volume m3d-client-2
16: type protocol/client
17: option remote-host g2
18: option remote-subvolume /g2
19: option transport-type tcp
20: end-volume
21:
22: volume m3d-dht
23: type cluster/distribute
24: subvolumes m3d-client-0 m3d-client-1 m3d-client-2
25: end-volume
26:
27: volume m3d-quota
28: type features/quota
29: option limit-set /1Gg:1GB,/10Gg:10GB,/5Gg:5GB,/512Mb:512MB,/dav/256MB:256MB,/dav/1GB:1GB,/dav/5GB:5GB,/dav/10GB:10GB,/cifs/256Mb:256MB,/dav/128mb:128MB,/dav/192mb:192MB,/cifs/192mb:192MB
30: option timeout 0
31: subvolumes m3d-dht
32: end-volume
33:
34: volume m3d-write-behind
35: type performance/write-behind
36: subvolumes m3d-quota
37: end-volume
38:
39: volume m3d-read-ahead
40: type performance/read-ahead
41: subvolumes m3d-write-behind
42: end-volume
43:
44: volume m3d-io-cache
45: type performance/io-cache
46: subvolumes m3d-read-ahead
47: end-volume
48:
49: volume m3d-quick-read
50: type performance/quick-read
51: subvolumes m3d-io-cache
52: end-volume
53:
54: volume m3d-stat-prefetch
55: type performance/stat-prefetch
56: subvolumes m3d-quick-read
57: end-volume
58:
59: volume m3d
60: type debug/io-stats
61: option latency-measurement off
62: option count-fop-hits off
63: subvolumes m3d-stat-prefetch
64: end-volume
+------------------------------------------------------------------------------+
[2012-04-19 16:37:12.729422] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7ff9c3025ddc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7ff9c3025e6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x443) [0x7ff9bf0f7913]))) 0-dict: data is NULL
[2012-04-19 16:37:12.729481] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7ff9c3025ddc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7ff9c3025e6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x59d) [0x7ff9bf0f7a6d]))) 0-dict: data is NULL
[2012-04-19 16:37:12.729531] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7ff9c3025ddc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7ff9c3025e6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x72f) [0x7ff9bf0f7bff]))) 0-dict: data is NULL
[2012-04-19 16:37:12.729580] W [dict.c:1153:data_to_str] (-->/usr/lib/libglusterfs.so.0(+0x18ddc) [0x7ff9c3025ddc] (-->/usr/lib/libglusterfs.so.0(+0x18e6a) [0x7ff9c3025e6a] (-->/usr/lib/glusterfs/3.2.6/xlator/performance/io-cache.so(reconfigure+0x74b) [0x7ff9bf0f7c1b]))) 0-dict: data is NULL
[2012-04-20 10:15:31.247530] W [glusterfsd.c:727:cleanup_and_exit] (-->/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7ff9c250f90d] (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7ff9c27c4b50] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xd5) [0x7ff9c349d325]))) 0-: received signum (15), shutting down
